-- Logs begin at Mon 2022-01-17 20:39:09 UTC, end at Mon 2022-01-17 21:46:36 UTC. -- Jan 17 21:11:59.951686 dv-cinder-824895-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 17 21:11:59.962257 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 17 21:11:59.964269 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 17 21:11:59 2022] *** Jan 17 21:11:59.964269 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 17 21:11:59.964269 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 17 21:11:59.964269 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: nodename: dv-cinder-824895-3-iscsi Jan 17 21:11:59.964269 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: machine: x86_64 Jan 17 21:11:59.964269 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: clock source: unix Jan 17 21:11:59.964269 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: pcre jit disabled Jan 17 21:11:59.964269 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: detected number of CPU cores: 4 Jan 17 21:11:59.964269 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: current working directory: / Jan 17 21:11:59.964269 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: detected binary path: /usr/bin/uwsgi-core Jan 17 21:11:59.964897 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: your processes number limit is 47680 Jan 17 21:11:59.964897 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: your memory page size is 4096 bytes Jan 17 21:11:59.964897 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: detected max file descriptor number: 2048 Jan 17 21:11:59.964897 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: lock engine: pthread robust mutexes Jan 17 21:11:59.964897 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: thunder lock: enabled Jan 17 21:11:59.964897 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 17 21:11:59.964897 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 17 21:12:00.011765 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: Python main interpreter initialized at 0x55828523f9c0 Jan 17 21:12:00.011765 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: python threads support enabled Jan 17 21:12:00.011765 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: your server socket listen backlog is limited to 100 connections Jan 17 21:12:00.011765 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: your mercy for graceful operations on workers is 90 seconds Jan 17 21:12:00.012196 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: mapped 403077 bytes (393 KB) for 2 cores Jan 17 21:12:00.012196 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: *** Operational MODE: preforking *** Jan 17 21:12:00.012506 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: *** uWSGI is running in multiple interpreter mode *** Jan 17 21:12:00.012506 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: spawned uWSGI master process (pid: 101757) Jan 17 21:12:00.012717 dv-cinder-824895-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 17 21:12:00.013520 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: spawned uWSGI worker 1 (pid: 101758, cores: 1) Jan 17 21:12:00.015460 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: spawned uWSGI worker 2 (pid: 101759, cores: 1) Jan 17 21:12:00.015460 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 17 21:12:01.892517 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 21:12:01.892517 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: from cryptography.utils import int_from_bytes Jan 17 21:12:01.893604 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 21:12:01.893604 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: from cryptography.utils import int_from_bytes Jan 17 21:12:01.894069 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 21:12:01.894069 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: from cryptography.utils import int_from_bytes Jan 17 21:12:01.894281 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 21:12:01.894281 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: from cryptography.utils import int_from_bytes Jan 17 21:12:04.504232 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 17 21:12:04.504853 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 17 21:12:04.505002 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 17 21:12:04.505374 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 17 21:12:04.505631 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 17 21:12:04.506001 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 17 21:12:04.506088 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 17 21:12:04.506173 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.506332 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.506428 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 17 21:12:04.507225 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.507328 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 17 21:12:04.507513 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 17 21:12:04.507606 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.507876 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.507972 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.508192 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.508285 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.508546 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.508650 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.508869 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.508963 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.509260 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.509368 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.509457 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.509538 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.509771 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.509863 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.510100 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824895-3-iscsi {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.510194 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.510426 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.510512 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.510719 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.510837 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.511005 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.511143 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.511329 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824895-3-iscsi {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.511437 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.511636 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.511723 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.511948 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.512034 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.512258 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.512396 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.512598 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.512798 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.513226 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.513226 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.513463 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.513533 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.513598 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.513829 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.514015 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.514213 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.514408 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.514588 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.514772 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.514954 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.515142 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.515324 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.515541 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.515725 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.515913 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.516096 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.516208 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.516516 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.516703 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.516888 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824895-3-iscsi {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.517076 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.517265 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.517446 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.517663 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.517863 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.518050 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.518238 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824895-3-iscsi {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.518428 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.518614 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.518768 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.518902 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.519065 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.519207 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.519461 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.519673 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.519812 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.519938 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.520100 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.520229 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.520360 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.520522 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.520661 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.520789 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.520920 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.521061 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.521263 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.521439 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.521571 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.521695 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.521820 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.521945 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.522077 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.522804 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.522954 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.523089 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.523215 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.523340 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.523464 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.523598 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.523726 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.523851 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.523975 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.524133 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.524275 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.524423 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.524563 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.524717 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.524846 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.524974 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.525111 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.525239 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.525363 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.525495 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.525621 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.525862 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.526006 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.526132 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.526257 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.526381 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.526520 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.526662 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.526798 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.526923 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.527048 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.527172 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.527304 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.527429 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.527560 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.527691 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.527818 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.527949 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.528088 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.528222 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.528348 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.528540 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.528664 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.528798 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.528938 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.529065 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.529196 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.529388 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.529517 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.529656 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.529859 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.529991 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.530123 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.530256 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.530418 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.530553 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.530831 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.530989 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.531098 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.531238 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.531435 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.531574 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.531708 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.531842 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.532007 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.532151 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.532317 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.532483 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.532665 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.532805 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.532991 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.533121 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.533305 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.533443 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.533615 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.533754 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.533926 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.534054 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.534193 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.534327 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.534455 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.534585 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.534772 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.534900 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.535098 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.535220 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.535399 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.535521 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.535711 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.535839 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.536021 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.536156 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.536327 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.536497 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.536659 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.536796 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.536969 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.537096 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.537271 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.537398 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.537580 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.537708 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.537927 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.538056 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.538239 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.538368 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.538548 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.538685 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.538855 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.538981 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.539162 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.539290 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.539472 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.539609 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.539779 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.539988 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.540118 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.540249 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.540398 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.540537 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.540713 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.540840 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.541021 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.541145 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.541330 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.541489 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.541685 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.541814 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.541938 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.542073 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.542239 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.542376 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.542549 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.542685 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.542856 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.542985 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.543177 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.543318 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.543482 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.543621 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.543788 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.543917 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.544109 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.544247 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.544432 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.544572 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.544741 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.544876 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.545062 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.545274 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.545410 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.545535 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.545668 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.545804 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.545965 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.546093 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.546273 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.546402 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.546579 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.546707 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.546886 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.547016 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.547191 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.547324 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.547493 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.547619 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.547794 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.547921 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.548097 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.548223 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.548424 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.548558 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.548730 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.548861 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.549046 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.549174 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.549353 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.549488 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.549665 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.549798 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.550044 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.550191 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.550325 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.550461 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.550587 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:12:04.550712 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.550914 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.551249 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.551479 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.551621 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.551831 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.551962 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.552148 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.552276 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.552498 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.552630 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.552820 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.552957 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.553141 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.553270 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.553500 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.553635 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.553831 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.553960 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.554144 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.554270 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.554456 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.554583 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.554767 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.554895 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.555087 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.555216 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.555407 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.555537 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.555727 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.556046 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.556177 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.556365 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.556537 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.556704 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.556839 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.557025 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.557153 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.557340 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.557482 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.557660 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.557991 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.558313 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.558451 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.558627 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.558766 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.558969 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.559105 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.559312 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.559451 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.559626 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.559757 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.559952 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.560104 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.560306 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.560526 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.560664 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.560792 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.560917 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.561043 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.561196 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.561355 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.561494 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.561679 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.561824 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.562019 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.562157 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.562323 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.562463 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.562644 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.562774 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.562986 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.563123 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.563310 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.563441 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.563633 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.563768 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.563939 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.564067 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.564246 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.564396 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.564580 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.564720 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.564885 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.565015 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.565194 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.565323 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.565521 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.565658 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.565827 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.565954 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.566153 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.566298 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.566461 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.566595 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.566776 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.566919 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.567086 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.567216 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.567392 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.567521 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.567759 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.567904 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.568031 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.568154 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.568299 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.568463 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.568643 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.568854 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.569478 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.569606 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.569767 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.569897 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.570094 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.570232 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.570443 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.570582 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.570716 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.570845 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.570984 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.571112 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.571295 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.571424 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.571606 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.571735 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.571920 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.572138 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.572267 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.572470 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.572597 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.572721 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.572860 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.572996 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.573192 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.573320 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.573525 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.573659 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.573829 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.573960 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.574156 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.574285 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.574483 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.574624 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.574800 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.574935 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.575106 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.575233 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.575418 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.575553 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.575722 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.575848 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.576027 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.576155 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.576334 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.576504 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.576666 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.576787 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.576975 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.577113 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.577280 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.577419 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.577583 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.577713 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.577889 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.578018 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.578189 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.578326 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.578495 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.578624 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.578808 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.578935 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.579112 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.579250 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.579415 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.579549 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.579718 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.579848 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.580024 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.580153 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.580351 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.580587 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.580717 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.580841 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.581026 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.581157 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.581358 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.581486 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.581679 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.581819 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.581992 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.582142 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.582341 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.582471 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.582596 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.582730 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.582911 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.583040 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.583224 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.583360 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.583534 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.583671 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.583847 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.583974 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.584158 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.584292 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.584503 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.584663 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.585394 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.585528 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.585719 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.585942 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.586085 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.586368 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.586520 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.586656 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.586784 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.586939 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.587076 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.587255 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.587383 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.587610 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.587740 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.587930 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.588112 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.588260 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.588413 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.588584 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.588858 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.588987 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.589195 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.589325 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.589504 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.589658 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.589817 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.589946 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.590128 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.590284 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.590448 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.590592 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.590808 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.590948 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.591084 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.591210 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.591342 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.591520 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.591650 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.591837 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.591975 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.592162 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.592299 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.592574 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.592707 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.592904 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.593035 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.593226 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.593746 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.593886 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.594295 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.594435 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.594571 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.594698 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.594830 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.594966 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.595101 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.595101 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.595968 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.596096 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.596222 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.596347 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.596795 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.596930 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.597058 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.597183 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.597438 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.597564 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.597699 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.597826 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.597950 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.598089 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.598215 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.598339 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.598477 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.598603 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.598728 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.598860 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.598987 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.599120 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.599255 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.599380 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.599505 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.599630 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.599754 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.599961 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.600089 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.600236 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.600359 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.600569 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.600704 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.600936 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.601067 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.601205 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.601333 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.601459 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.601591 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.601727 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.601855 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.601980 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.602105 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.602235 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.602363 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.602497 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.602728 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.602859 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.602985 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.603111 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.603245 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.603374 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.603500 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.603625 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.603751 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.603876 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.604010 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.604137 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.604263 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.604404 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.604532 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.604669 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.604830 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.604959 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.605085 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.605210 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.605335 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.605470 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.605610 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.605737 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.605863 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.605987 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.606112 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.606247 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.606381 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.606531 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.606696 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.606826 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.607022 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.607160 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.607342 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.607471 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.607656 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.607785 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.607972 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.608110 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.608288 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.608490 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.608648 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.608777 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.608932 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.609073 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.609243 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.609371 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.609561 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.609690 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.609876 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.610141 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.610270 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.610472 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.610601 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.610785 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.610927 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.611125 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.611237 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.611410 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.611674 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.611788 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.612015 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.612130 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.612339 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.612476 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.612778 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.612927 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.613086 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.613220 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.613347 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.613473 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.613598 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.613733 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.613861 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.613976 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.614177 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.614291 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.614482 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.614577 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.614788 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.614898 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.615093 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.615189 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.615403 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.615494 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.615716 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.615847 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.616048 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.616282 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.616404 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.616510 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.616708 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.616809 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.617026 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.617120 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.617319 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.617409 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.617632 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.617734 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.617936 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.618025 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.618258 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.618360 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.618566 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.618667 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.618869 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.618956 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.619172 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.619261 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.619475 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.619571 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.619801 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.619888 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.620110 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.620196 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.620438 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.620545 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.620753 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.620853 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.621060 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.621161 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.621410 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.621499 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.621713 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.621888 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.622040 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.622135 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.622346 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.622434 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.622651 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.622738 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.622955 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.623130 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.623265 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.623352 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.623570 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.623657 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.623873 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.623985 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.624188 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.624297 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.624518 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.624619 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.624830 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.624927 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.625139 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.625227 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.625443 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.625530 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.625757 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.625882 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.626059 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.626152 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.626375 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.626463 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.626687 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.626783 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.626994 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.627082 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.627298 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.627382 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.627601 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.627688 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.627907 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.628002 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.628210 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.628298 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.628540 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.628630 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.628840 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.628925 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.629155 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.629488 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.629792 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.630095 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.630408 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.630721 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.631018 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.631342 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.632189 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.632512 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.632819 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.633129 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.633435 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.633790 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.634102 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.634294 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.634622 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.634838 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.634943 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.635187 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.635290 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.635531 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.635696 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.635842 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.635982 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.636133 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.636286 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.636453 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.636598 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.636747 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.636888 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.637041 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.637182 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.637330 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.637476 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.637616 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.637762 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.637908 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.638066 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.638206 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.638413 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.638570 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.638741 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.638889 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.639061 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.639208 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.639378 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.639526 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.639674 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.639813 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.640020 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.640227 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.640418 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.640640 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.640824 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.641065 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.641271 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.641525 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.641677 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.641828 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.641976 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.642117 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.642310 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.642470 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.642623 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.642777 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.642926 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.643084 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.643309 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.643454 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.643593 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.643780 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.643934 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.644098 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.644254 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.644426 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.644599 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.644770 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.644912 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.645052 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.645254 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.645402 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.645630 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.645782 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.645951 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.646243 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.646398 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.646586 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.646744 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.646885 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.647042 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.647240 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.647509 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.647656 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.648360 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.648536 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.648676 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.648955 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.649101 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.649287 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.649448 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.649590 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.649779 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.649925 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.650115 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.650275 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.650453 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.650605 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.650783 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.650928 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.651094 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.651250 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.651398 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.651567 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.651790 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.651958 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.652099 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.652247 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.652412 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.652569 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.652711 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.652859 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.652999 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.653151 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.653310 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.653531 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.653678 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.653817 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.653980 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.654121 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.654260 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.654400 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.654539 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.654678 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.654831 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.654971 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.655110 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.655249 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.655413 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.655559 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.655707 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.655859 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.656030 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.656176 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.656350 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.656547 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.656775 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.656928 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.657069 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.657209 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.657393 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.657539 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.657688 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.657829 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.658008 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.658156 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.658317 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.658472 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.658613 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.658753 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.658920 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.659067 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.659243 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.659397 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.659538 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.659682 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.659834 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.659974 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.660120 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.660276 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.660523 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.660680 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.660847 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.661005 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.661156 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.661297 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.661467 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.661614 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.661782 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.662030 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.662191 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.662332 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.662471 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.662617 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.662890 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.663038 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.663219 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.663366 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.663524 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.663763 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.663908 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.664054 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.664216 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.664357 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.664558 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.664697 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.664836 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.664987 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.665127 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.665266 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.665413 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.665552 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.665691 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.665842 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.666009 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.666158 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.666300 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.666462 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.666609 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.666785 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.666933 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.667102 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.667247 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.667418 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.667564 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.667738 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.667892 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.668071 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.668218 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.668404 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.668567 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.668709 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.668849 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.669025 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.669179 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.669360 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.669522 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.669697 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.669839 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.670001 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.670159 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.670363 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.670518 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.670660 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.670800 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.670957 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.671098 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.671269 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.671457 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.671605 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.671772 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.671915 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.672190 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.672348 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.672529 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.672672 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.672811 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.672950 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.673113 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.673262 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.673404 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.673552 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.673693 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.673945 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.674093 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.674244 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.674384 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.674532 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.674675 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.674815 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.674954 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.675093 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.675232 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.675380 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.675522 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.675662 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.675802 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.675940 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.676090 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.676240 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.676460 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.676620 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.676763 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.676911 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.677084 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.677236 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.677385 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.677552 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.677706 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.677872 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.678032 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.678206 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.678353 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.679059 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.679214 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.679360 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.679516 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.679664 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.679817 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.679965 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.680112 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.680280 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.680474 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.680637 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.680791 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.680949 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.681095 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.681252 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.681399 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.681545 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.681698 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.681845 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.682001 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.682175 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.682407 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.682560 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.682717 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.682881 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.683029 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.683187 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.683342 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.683490 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.683636 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.683781 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.683944 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.684185 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.684338 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.684540 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.684687 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.684845 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.685009 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.685157 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.685303 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.685448 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.685593 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.685738 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.685892 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.686039 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.686193 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.686347 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.686495 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.686640 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.686811 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.686959 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.687105 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.687252 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.687397 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.687543 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.687697 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.687853 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.688000 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.688145 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.688291 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.688483 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.688576 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.688646 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.688712 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.688963 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.689058 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.689326 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.689414 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.689652 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.689780 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.689985 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.690201 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.690298 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.690561 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.690649 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.690896 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.690990 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.691206 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.691370 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.691533 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.691710 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.691858 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.692076 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.692189 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.692467 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.692631 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.692815 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.693074 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.693230 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.693382 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.693590 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.693695 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.693927 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.694016 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.694898 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.695054 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.695212 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.695383 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.695518 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.695722 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.695866 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.696164 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.696305 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.696519 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.696704 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.696865 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.697124 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.697265 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.697510 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.697688 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.697847 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.698166 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.698362 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.698499 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.698632 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.698811 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.698954 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.699135 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.699420 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.699555 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.699774 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.699906 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.700096 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.700239 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.700435 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.700537 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.700756 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.700845 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.701072 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.701168 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.701393 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.701708 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.701800 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.702038 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.702135 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.702356 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.702612 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.702768 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.702954 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.703078 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.703283 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.703414 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.703604 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.703703 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.703931 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.704096 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.704251 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.704350 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.704599 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.704750 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.704924 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.705074 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.705209 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.705348 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.705530 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.705751 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.705911 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.706120 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.706279 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.706433 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.706596 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.706762 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.706919 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.707091 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.707252 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.707404 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.707559 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.707713 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.707867 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.708036 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.708036 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.708332 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.708509 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.708634 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.708776 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.708972 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.709100 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.709310 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.709434 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.709703 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.709839 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.710030 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.710154 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.710354 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.710478 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.710675 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.710812 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.710992 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.711116 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.711309 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.711435 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.711628 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.711751 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.711942 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.712075 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.712257 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.712428 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.712608 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.712755 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.712938 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.713079 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.713267 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.713387 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.713611 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.713733 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.713941 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.714062 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.714262 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.714482 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.714611 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.714841 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.714962 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.715165 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.715421 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.715550 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.715748 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.715947 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.716087 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.716211 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.716433 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.716579 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.716769 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.716895 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.717083 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.717208 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.717398 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.717537 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.717725 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.717851 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.718038 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.718169 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.718611 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.718739 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.718927 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.719052 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.719243 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.719365 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.719556 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.719680 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.719873 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.719998 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.720189 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.720318 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.720522 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.720646 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.720858 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.720982 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.721172 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.721297 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.721486 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.721776 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.721903 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.722103 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.722228 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.722415 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.722540 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.722735 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.722888 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.723047 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.723190 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.723356 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.723484 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.723676 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.723810 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.723987 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.724113 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.724304 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.724456 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.724644 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.724785 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.724964 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.725090 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.725317 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.725510 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.725727 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.725942 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.726078 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.726261 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.726425 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.726582 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.726737 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.726892 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.727047 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.727402 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.727582 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.727739 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.727896 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.728071 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.728228 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.728426 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.728551 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.728697 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.728820 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.728956 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.729079 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.729214 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.729337 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.729461 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.729593 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.729593 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.729848 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.729983 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.730108 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.730233 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.730427 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.730554 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.730778 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.730902 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.731095 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.731229 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.731409 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.731534 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.731730 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.731856 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.732040 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.732163 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.732357 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.732539 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.732681 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.732820 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.733000 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.733125 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.733314 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.733464 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.733621 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.733759 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.733933 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.734058 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.734248 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.734456 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.734581 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.734704 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.734864 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.734989 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.735179 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.735319 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.735511 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.735657 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.735846 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.735973 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.736264 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.736453 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.736581 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.736830 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.736955 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.737155 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.737295 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.737473 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.737609 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.737792 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.737930 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.738108 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.738244 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.738423 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.738549 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.738746 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.738869 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.739078 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.739214 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.739396 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.739521 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.739705 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.739828 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.740051 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.740180 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.740339 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.740516 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.740682 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.740832 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.741550 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.741741 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.741876 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.742061 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.742187 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.742391 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.742597 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.742722 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.742859 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.743029 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.743155 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.743362 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.743518 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.743679 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.743804 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.744017 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.744143 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.744364 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.744517 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.744705 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.744840 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.745023 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.745159 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.745340 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.745475 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.745656 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.745797 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.745965 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.746093 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.746408 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.746546 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.746680 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.746816 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.746946 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.747090 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.747257 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.747394 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.747588 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.747715 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.747910 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.748067 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.748239 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.748365 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.748591 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.748718 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.748922 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.749065 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.749251 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.749376 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.749575 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.749700 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.749891 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.750026 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.750207 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.750345 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.750532 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.750658 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.750850 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.750977 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.751172 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.751299 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.751491 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.751618 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.751809 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.751935 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.752120 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.752245 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.752454 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.752598 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.752765 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.752891 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.753098 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.753225 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.753434 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.753577 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.753756 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.753883 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.754083 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.754208 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.754449 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.754599 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.754723 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.754858 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.755036 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.755166 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.755364 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.755490 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.755694 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.755821 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.756028 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.756169 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.756339 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.756513 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.757284 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.757416 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.757602 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.757730 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.757924 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.758051 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.758247 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.758384 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.758567 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.758712 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.758883 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.759010 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.759201 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.759340 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.759546 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.759686 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.759883 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.760010 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.760197 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.760323 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.760561 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.760708 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.760890 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.761016 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.761219 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.761345 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.761484 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101759) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 17 21:12:04.761619 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.761850 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.762187 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.762506 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.762831 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.763153 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.763475 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.763802 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.764126 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.764484 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.764821 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.765155 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.765490 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.765846 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.766172 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.766524 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.766865 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.767186 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.767509 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.767821 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:12:04.768085 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 17 21:12:04.784345 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_db.sqlalchemy.engines [None req-f0dbf8a5-f349-4d66-8b22-f155469dccf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:12:04.790744 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG oslo_db.sqlalchemy.engines [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:12:04.853832 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.context [None req-f0dbf8a5-f349-4d66-8b22-f155469dccf1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c701e1f9-5e14-4d1d-beb5-81eb20dd71e0(cell1) {{(pid=101759) load_cells /opt/stack/nova/nova/context.py:464}} Jan 17 21:12:04.858251 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-f0dbf8a5-f349-4d66-8b22-f155469dccf1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:12:04.858727 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.context [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c701e1f9-5e14-4d1d-beb5-81eb20dd71e0(cell1) {{(pid=101758) load_cells /opt/stack/nova/nova/context.py:464}} Jan 17 21:12:04.859884 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-f0dbf8a5-f349-4d66-8b22-f155469dccf1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:12:04.860754 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-f0dbf8a5-f349-4d66-8b22-f155469dccf1 None None] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:12:04.862709 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-f0dbf8a5-f349-4d66-8b22-f155469dccf1 None None] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:12:04.863044 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG oslo_concurrency.lockutils [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:12:04.864713 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG oslo_concurrency.lockutils [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:12:04.865536 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG oslo_concurrency.lockutils [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:12:04.868059 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG oslo_concurrency.lockutils [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:12:04.874186 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_db.sqlalchemy.engines [None req-f0dbf8a5-f349-4d66-8b22-f155469dccf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:12:04.877663 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_db.sqlalchemy.engines [None req-f0dbf8a5-f349-4d66-8b22-f155469dccf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:12:04.882589 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG oslo_db.sqlalchemy.engines [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:12:04.886929 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG oslo_db.sqlalchemy.engines [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:12:05.044284 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_db.sqlalchemy.engines [None req-f0dbf8a5-f349-4d66-8b22-f155469dccf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101759) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:12:05.050483 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG oslo_db.sqlalchemy.engines [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:12:05.391643 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: WARNING keystonemiddleware.auth_token [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 21:12:05.394145 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: WARNING keystonemiddleware.auth_token [None req-f0dbf8a5-f349-4d66-8b22-f155469dccf1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 21:12:05.398959 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: WARNING keystonemiddleware.auth_token [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 21:12:05.401551 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: WARNING keystonemiddleware.auth_token [None req-f0dbf8a5-f349-4d66-8b22-f155469dccf1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 21:12:05.739241 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: WARNING keystonemiddleware.auth_token [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 21:12:05.745164 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: WARNING keystonemiddleware.auth_token [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 21:12:05.748623 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: WARNING keystonemiddleware.auth_token [None req-f0dbf8a5-f349-4d66-8b22-f155469dccf1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 21:12:05.750201 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55828523f9c0 pid: 101758 (default app) Jan 17 21:12:05.752237 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:12:05.753420 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001736 Jan 17 21:12:05.753823 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Mon Jan 17 21:12:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:12:05.754031 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: WARNING keystonemiddleware.auth_token [None req-f0dbf8a5-f349-4d66-8b22-f155469dccf1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 21:12:05.759740 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55828523f9c0 pid: 101759 (default app) Jan 17 21:13:33.050142 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:13:33.051797 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002064 Jan 17 21:13:33.052207 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jan 17 21:13:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:13:33.500659 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-276d38a3-4e95-438c-a85e-09bb252ab1af admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:13:33.529759 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-276d38a3-4e95-438c-a85e-09bb252ab1af admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.470367 Jan 17 21:13:33.530401 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1291 bytes} [Mon Jan 17 21:13:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:13:35.884391 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:13:35.886011 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-56cfb22b-94b2-4aa7-9414-507e7f3e1120 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002054 Jan 17 21:13:35.892585 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jan 17 21:13:35 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:13:35.966412 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-db2080e9-7ab6-44d8-bb2d-f913d013fc9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:35.985562 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:13:35.985562 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: warnings.warn(msg) Jan 17 21:13:36.014454 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-db2080e9-7ab6-44d8-bb2d-f913d013fc9f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.120971 Jan 17 21:13:36.015230 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jan 17 21:13:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:13:36.245338 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-2bda61b1-b906-4b9b-88dd-3678f7342bf5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:36.247589 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:13:36.247589 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: warnings.warn(msg) Jan 17 21:13:36.302035 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-2bda61b1-b906-4b9b-88dd-3678f7342bf5 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278906 Jan 17 21:13:36.302814 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1335 bytes} [Mon Jan 17 21:13:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:13:38.754877 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-db2080e9-7ab6-44d8-bb2d-f913d013fc9f admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:13:38.755954 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-db2080e9-7ab6-44d8-bb2d-f913d013fc9f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jan 17 21:13:38.756388 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jan 17 21:13:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:13:38.863585 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-dcc3510e-5581-4778-bd32-d1505a602c49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "swap": 0, "id": "d1", "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:38.886324 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:13:38.886324 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: warnings.warn(msg) Jan 17 21:13:38.911578 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-dcc3510e-5581-4778-bd32-d1505a602c49 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148810 Jan 17 21:13:38.913783 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jan 17 21:13:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:13:38.925055 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-9399f89c-4a66-4234-89bc-5b032177f349 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:38.926538 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:13:38.926538 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: warnings.warn(msg) Jan 17 21:13:38.974612 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-9399f89c-4a66-4234-89bc-5b032177f349 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053471 Jan 17 21:13:38.975494 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1335 bytes} [Mon Jan 17 21:13:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:13:41.277743 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-dcc3510e-5581-4778-bd32-d1505a602c49 admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:13:41.279325 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-dcc3510e-5581-4778-bd32-d1505a602c49 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002629 Jan 17 21:13:41.279913 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jan 17 21:13:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:13:41.348158 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-16b7f81b-9b79-4965-a440-4d817bb1fa25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "name": "ds1G", "id": "d2", "ram": 1024}} {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:41.369667 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-16b7f81b-9b79-4965-a440-4d817bb1fa25 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081058 Jan 17 21:13:41.371027 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jan 17 21:13:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:13:41.383557 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-dbed515c-8884-4bf2-8199-cdc308b8a094 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:41.409347 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-dbed515c-8884-4bf2-8199-cdc308b8a094 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029710 Jan 17 21:13:41.410141 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1335 bytes} [Mon Jan 17 21:13:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:13:43.748638 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-16b7f81b-9b79-4965-a440-4d817bb1fa25 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:13:43.749708 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-16b7f81b-9b79-4965-a440-4d817bb1fa25 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Jan 17 21:13:43.750179 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jan 17 21:13:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:13:43.812542 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-f97fd83d-1a66-40a2-9971-d217163f5fee admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "id": "d3"}} {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:43.831640 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-f97fd83d-1a66-40a2-9971-d217163f5fee admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074521 Jan 17 21:13:43.832180 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jan 17 21:13:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:13:43.844668 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-27ad26eb-e449-42a7-878f-4d962da2a91d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:43.869114 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-27ad26eb-e449-42a7-878f-4d962da2a91d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028237 Jan 17 21:13:43.869887 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1335 bytes} [Mon Jan 17 21:13:43 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:13:46.200140 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-f97fd83d-1a66-40a2-9971-d217163f5fee admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:13:46.201088 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-f97fd83d-1a66-40a2-9971-d217163f5fee admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jan 17 21:13:46.201499 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jan 17 21:13:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:13:46.262797 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-4eb1c180-c67a-4528-837c-e13915dfd1ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096}} {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:46.282686 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-4eb1c180-c67a-4528-837c-e13915dfd1ba admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074002 Jan 17 21:13:46.283981 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jan 17 21:13:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:13:46.296029 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-7dc35371-f0b1-4051-a5a2-40a352eb4355 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:46.320952 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-7dc35371-f0b1-4051-a5a2-40a352eb4355 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028567 Jan 17 21:13:46.332447 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1335 bytes} [Mon Jan 17 21:13:46 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:13:48.636122 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-4eb1c180-c67a-4528-837c-e13915dfd1ba admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:13:48.637096 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-4eb1c180-c67a-4528-837c-e13915dfd1ba admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jan 17 21:13:48.637730 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jan 17 21:13:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:13:48.706605 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-ab128bca-8510-499a-bf96-b14acf18e886 admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:13:48.735071 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-ab128bca-8510-499a-bf96-b14acf18e886 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.090080 Jan 17 21:13:48.737097 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1291 bytes} [Mon Jan 17 21:13:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:13:51.137123 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-4eb1c180-c67a-4528-837c-e13915dfd1ba admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:13:51.138110 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-4eb1c180-c67a-4528-837c-e13915dfd1ba admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jan 17 21:13:51.138521 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jan 17 21:13:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:13:51.210341 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-47a04ee9-ade8-4d39-b22b-63c5ca966665 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "disk": 1, "id": "1"}} {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:51.233583 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-47a04ee9-ade8-4d39-b22b-63c5ca966665 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.087359 Jan 17 21:13:51.234388 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jan 17 21:13:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:13:51.247224 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-87d76219-6849-436b-8f25-ad85da9b4445 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:51.272585 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-87d76219-6849-436b-8f25-ad85da9b4445 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029062 Jan 17 21:13:51.273200 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1332 bytes} [Mon Jan 17 21:13:51 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:13:54.256755 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-47a04ee9-ade8-4d39-b22b-63c5ca966665 admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:13:54.258952 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-47a04ee9-ade8-4d39-b22b-63c5ca966665 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003229 Jan 17 21:13:54.259833 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jan 17 21:13:54 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:13:54.322452 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-1a56b2ad-5ba4-45df-b047-c7c571db98fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:54.342228 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-1a56b2ad-5ba4-45df-b047-c7c571db98fe admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075838 Jan 17 21:13:54.342775 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jan 17 21:13:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:13:54.355114 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-95f30174-3eb5-496c-9e5b-690910cff7c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:54.390639 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-95f30174-3eb5-496c-9e5b-690910cff7c7 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039097 Jan 17 21:13:54.391238 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1332 bytes} [Mon Jan 17 21:13:54 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:13:56.910351 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-1a56b2ad-5ba4-45df-b047-c7c571db98fe admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:13:56.911373 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-1a56b2ad-5ba4-45df-b047-c7c571db98fe admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jan 17 21:13:56.911780 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jan 17 21:13:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:13:56.975475 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-b5f8a51a-c95c-4caf-9367-00272b7f7918 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0}} {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:56.995822 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-b5f8a51a-c95c-4caf-9367-00272b7f7918 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.077623 Jan 17 21:13:56.996396 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jan 17 21:13:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:13:57.008635 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-7d6ce74c-43c5-4404-8b1e-4f703df82452 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:57.034231 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-7d6ce74c-43c5-4404-8b1e-4f703df82452 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029075 Jan 17 21:13:57.034974 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1332 bytes} [Mon Jan 17 21:13:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:13:59.389859 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-b5f8a51a-c95c-4caf-9367-00272b7f7918 admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:13:59.392329 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-b5f8a51a-c95c-4caf-9367-00272b7f7918 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002157 Jan 17 21:13:59.393615 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jan 17 21:13:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:13:59.457539 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-2bd3441c-e1bf-4d58-9d25-84363cd53cba admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80, "swap": 0, "ram": 8192}} {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:59.476633 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-2bd3441c-e1bf-4d58-9d25-84363cd53cba admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077362 Jan 17 21:13:59.477478 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jan 17 21:13:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:13:59.490299 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-c30bace3-94a8-445f-9542-4cb2f73bc551 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:13:59.514956 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-c30bace3-94a8-445f-9542-4cb2f73bc551 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028461 Jan 17 21:13:59.515660 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1332 bytes} [Mon Jan 17 21:13:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:14:01.855132 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-2bd3441c-e1bf-4d58-9d25-84363cd53cba admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:01.856155 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-2bd3441c-e1bf-4d58-9d25-84363cd53cba admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jan 17 21:14:01.856593 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jan 17 21:14:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:14:01.925485 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-68e98c38-485f-4ff4-9bf9-d85914091c89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:14:01.952243 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-68e98c38-485f-4ff4-9bf9-d85914091c89 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.089410 Jan 17 21:14:01.953189 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jan 17 21:14:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:14:01.965991 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-831838e5-9b21-41d0-bdc1-a59c5673d8e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:14:01.994337 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-831838e5-9b21-41d0-bdc1-a59c5673d8e3 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032855 Jan 17 21:14:01.995112 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1332 bytes} [Mon Jan 17 21:14:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:14:24.116132 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-68e98c38-485f-4ff4-9bf9-d85914091c89 admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:24.117184 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-68e98c38-485f-4ff4-9bf9-d85914091c89 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jan 17 21:14:24.117589 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jan 17 21:14:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:14:24.175776 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-621e1924-1eec-4395-bdc2-99f4d07b2fcf admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:24.192316 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-621e1924-1eec-4395-bdc2-99f4d07b2fcf admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068579 Jan 17 21:14:24.192874 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1291 bytes} [Mon Jan 17 21:14:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:14:25.554911 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-68e98c38-485f-4ff4-9bf9-d85914091c89 admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:25.555952 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-68e98c38-485f-4ff4-9bf9-d85914091c89 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jan 17 21:14:25.556353 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jan 17 21:14:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:14:25.764742 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-ee849c9a-af52-41fe-8ff5-e9d324ab4fa1 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:25.770246 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.wsgi [None req-ee849c9a-af52-41fe-8ff5-e9d324ab4fa1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 17 21:14:25.770847 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-ee849c9a-af52-41fe-8ff5-e9d324ab4fa1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:14:25.771654 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-ee849c9a-af52-41fe-8ff5-e9d324ab4fa1 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059128 Jan 17 21:14:25.772184 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Mon Jan 17 21:14:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 17 21:14:25.781507 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-52340c7e-dcb4-4f12-bf48-accd5c107ccf admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:25.802359 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-52340c7e-dcb4-4f12-bf48-accd5c107ccf admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024324 Jan 17 21:14:25.802935 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jan 17 21:14:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:14:25.813239 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-0b6d0e9f-a406-455d-89e8-aaa15b6936f7 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:25.834287 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-0b6d0e9f-a406-455d-89e8-aaa15b6936f7 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025122 Jan 17 21:14:25.834854 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jan 17 21:14:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:14:25.844686 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-7080f588-fd1b-460e-9ee7-e171e8ce90c5 admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:25.850270 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.wsgi [None req-7080f588-fd1b-460e-9ee7-e171e8ce90c5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 17 21:14:25.850836 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-7080f588-fd1b-460e-9ee7-e171e8ce90c5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:14:25.851623 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-7080f588-fd1b-460e-9ee7-e171e8ce90c5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010899 Jan 17 21:14:25.852128 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Mon Jan 17 21:14:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 17 21:14:27.152835 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-0b6d0e9f-a406-455d-89e8-aaa15b6936f7 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:27.154413 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-0b6d0e9f-a406-455d-89e8-aaa15b6936f7 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jan 17 21:14:27.154413 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jan 17 21:14:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:14:27.352801 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-530b03d8-7c98-48b8-b5e7-5afb800519f1 admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:27.358122 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.wsgi [None req-530b03d8-7c98-48b8-b5e7-5afb800519f1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 17 21:14:27.358685 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-530b03d8-7c98-48b8-b5e7-5afb800519f1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:14:27.359480 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-530b03d8-7c98-48b8-b5e7-5afb800519f1 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063971 Jan 17 21:14:27.359995 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Mon Jan 17 21:14:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 17 21:14:27.369362 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-ff1a4d23-e9e9-4d1f-97be-c9b3c44c0c59 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:27.383797 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-ff1a4d23-e9e9-4d1f-97be-c9b3c44c0c59 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017816 Jan 17 21:14:27.384402 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jan 17 21:14:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:14:27.394559 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-6834d65b-d330-4be9-9f1b-bdbb3ec9b417 admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:27.408584 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-6834d65b-d330-4be9-9f1b-bdbb3ec9b417 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018065 Jan 17 21:14:27.409116 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jan 17 21:14:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:14:27.418384 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-2401e3f9-cca0-4717-895d-8b0064b5b001 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:27.423803 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.wsgi [None req-2401e3f9-cca0-4717-895d-8b0064b5b001 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 17 21:14:27.424385 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-2401e3f9-cca0-4717-895d-8b0064b5b001 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:14:27.425199 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-2401e3f9-cca0-4717-895d-8b0064b5b001 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010387 Jan 17 21:14:27.425702 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Mon Jan 17 21:14:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 17 21:14:28.675310 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-6834d65b-d330-4be9-9f1b-bdbb3ec9b417 admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:28.676337 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-6834d65b-d330-4be9-9f1b-bdbb3ec9b417 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jan 17 21:14:28.676758 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jan 17 21:14:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:14:28.868001 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-89d36c1f-de42-40d6-aa29-a52871e4aef5 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:28.873214 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.wsgi [None req-89d36c1f-de42-40d6-aa29-a52871e4aef5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 17 21:14:28.873771 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-89d36c1f-de42-40d6-aa29-a52871e4aef5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101759) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:14:28.874551 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-89d36c1f-de42-40d6-aa29-a52871e4aef5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057509 Jan 17 21:14:28.875636 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jan 17 21:14:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 17 21:14:28.884921 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-f3d99f34-74f2-453c-86b3-9addb856369c admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:28.898494 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-f3d99f34-74f2-453c-86b3-9addb856369c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017109 Jan 17 21:14:28.899056 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jan 17 21:14:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:14:28.908802 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-6d018826-f4af-4af1-84d8-f317d1f6ea93 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:28.922499 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-6d018826-f4af-4af1-84d8-f317d1f6ea93 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017609 Jan 17 21:14:28.923042 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jan 17 21:14:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:14:28.932250 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-366127af-ddab-4b9e-a781-d5c6931596a8 admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:28.938097 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.wsgi [None req-366127af-ddab-4b9e-a781-d5c6931596a8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 17 21:14:28.938658 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-366127af-ddab-4b9e-a781-d5c6931596a8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:14:28.939442 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-366127af-ddab-4b9e-a781-d5c6931596a8 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010697 Jan 17 21:14:28.940281 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jan 17 21:14:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 17 21:14:30.199673 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-6d018826-f4af-4af1-84d8-f317d1f6ea93 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:30.200712 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-6d018826-f4af-4af1-84d8-f317d1f6ea93 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jan 17 21:14:30.201116 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jan 17 21:14:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:14:30.396877 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-1d99381e-84e5-481b-9a13-095e0b6f639b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:14:30.414815 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-1d99381e-84e5-481b-9a13-095e0b6f639b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068559 Jan 17 21:14:30.415353 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Mon Jan 17 21:14:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:14:31.673085 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-6d018826-f4af-4af1-84d8-f317d1f6ea93 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:31.674062 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-6d018826-f4af-4af1-84d8-f317d1f6ea93 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jan 17 21:14:31.674454 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jan 17 21:14:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:14:31.867087 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-42991bbe-7cb1-4d27-acef-45e2f303ffd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:14:31.884154 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-42991bbe-7cb1-4d27-acef-45e2f303ffd6 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070129 Jan 17 21:14:31.884675 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Mon Jan 17 21:14:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:14:33.167668 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-6d018826-f4af-4af1-84d8-f317d1f6ea93 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:33.168708 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-6d018826-f4af-4af1-84d8-f317d1f6ea93 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jan 17 21:14:33.169113 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jan 17 21:14:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:14:33.382629 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-cdc5fb8d-4c01-454c-9982-5fce7d01f8fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:14:33.403128 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-cdc5fb8d-4c01-454c-9982-5fce7d01f8fd admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.083841 Jan 17 21:14:33.404065 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Mon Jan 17 21:14:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:14:34.695343 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-6d018826-f4af-4af1-84d8-f317d1f6ea93 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:34.696289 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-6d018826-f4af-4af1-84d8-f317d1f6ea93 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jan 17 21:14:34.696745 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jan 17 21:14:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:14:34.901645 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-5d69131e-fd12-4c66-9469-e242030df178 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:14:34.919480 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-5d69131e-fd12-4c66-9469-e242030df178 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068141 Jan 17 21:14:34.920047 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Mon Jan 17 21:14:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:14:36.202354 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-6d018826-f4af-4af1-84d8-f317d1f6ea93 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:36.203962 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-6d018826-f4af-4af1-84d8-f317d1f6ea93 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002073 Jan 17 21:14:36.204568 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jan 17 21:14:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:14:36.399285 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-75776dc9-c416-4a8b-81c6-8d140e6237d0 admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:14:36.418879 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-75776dc9-c416-4a8b-81c6-8d140e6237d0 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070212 Jan 17 21:14:36.419426 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Mon Jan 17 21:14:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:15:23.215929 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-6d018826-f4af-4af1-84d8-f317d1f6ea93 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:15:23.217755 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-6d018826-f4af-4af1-84d8-f317d1f6ea93 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001727 Jan 17 21:15:23.218158 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jan 17 21:15:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:15:23.274314 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-2eb6f0ab-8b63-4311-b3ff-20d40ee3598c admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:15:23.294356 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-2eb6f0ab-8b63-4311-b3ff-20d40ee3598c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070400 Jan 17 21:15:23.294889 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1291 bytes} [Mon Jan 17 21:15:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:15:23.318034 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-2c2bf9d9-e6d6-45f9-b6c8-c43d826da805 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:15:23.325765 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-2c2bf9d9-e6d6-45f9-b6c8-c43d826da805 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011303 Jan 17 21:15:23.326295 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1282 bytes} [Mon Jan 17 21:15:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:15:23.338383 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-4c6a0382-4bf2-4f24-ad8e-2e1ac702f2ee admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:15:23.346420 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-4c6a0382-4bf2-4f24-ad8e-2e1ac702f2ee admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011624 Jan 17 21:15:23.346932 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1285 bytes} [Mon Jan 17 21:15:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:15:23.358144 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-2219871b-7646-4946-b8a2-b0a84182f2a3 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:15:23.366387 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-2219871b-7646-4946-b8a2-b0a84182f2a3 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011716 Jan 17 21:15:23.366959 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1285 bytes} [Mon Jan 17 21:15:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:15:23.378934 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-09d00bfb-bbc9-4fe1-bc79-1f47bba3930f admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:15:23.386545 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-09d00bfb-bbc9-4fe1-bc79-1f47bba3930f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011096 Jan 17 21:15:23.387054 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1282 bytes} [Mon Jan 17 21:15:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:16:48.316244 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-c2fb0d07-167f-470f-a202-94769e001858 tempest-verify_tempest_config-1311491436 tempest-verify_tempest_config-1311491436-project] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:16:48.318251 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-c2fb0d07-167f-470f-a202-94769e001858 tempest-verify_tempest_config-1311491436 tempest-verify_tempest_config-1311491436-project] 10.222.0.64 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106159 Jan 17 21:16:48.318855 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 34/69] 10.222.0.64 () {58 vars in 1133 bytes} [Mon Jan 17 21:16:48 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:18:16.488136 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-09d00bfb-bbc9-4fe1-bc79-1f47bba3930f admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:18:16.489167 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-09d00bfb-bbc9-4fe1-bc79-1f47bba3930f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jan 17 21:18:16.489558 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 36/70] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jan 17 21:18:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:18:16.744717 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-b27ed692-02e0-49d8-a588-08a0f9be1457 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:18:16.746504 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:18:16.746504 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: warnings.warn(msg) Jan 17 21:18:16.748101 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-b27ed692-02e0-49d8-a588-08a0f9be1457 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:18:16.748578 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-b27ed692-02e0-49d8-a588-08a0f9be1457 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:18:16.749374 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-b27ed692-02e0-49d8-a588-08a0f9be1457 admin admin] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:18:16.749799 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-b27ed692-02e0-49d8-a588-08a0f9be1457 admin admin] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:18:16.782153 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-b27ed692-02e0-49d8-a588-08a0f9be1457 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.146420 Jan 17 21:18:16.782717 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 35/71] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jan 17 21:18:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:18:18.094162 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-09d00bfb-bbc9-4fe1-bc79-1f47bba3930f admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:18:18.095173 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-09d00bfb-bbc9-4fe1-bc79-1f47bba3930f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jan 17 21:18:18.095570 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 37/72] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jan 17 21:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:18:18.290411 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-38f91f79-b191-455c-a5bd-4c1266c16baf admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:18:18.291608 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:18:18.291608 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: warnings.warn(msg) Jan 17 21:18:18.293170 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-38f91f79-b191-455c-a5bd-4c1266c16baf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:18:18.293619 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-38f91f79-b191-455c-a5bd-4c1266c16baf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:18:18.294425 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-38f91f79-b191-455c-a5bd-4c1266c16baf admin admin] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:18:18.294852 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-38f91f79-b191-455c-a5bd-4c1266c16baf admin admin] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:18:18.314426 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-38f91f79-b191-455c-a5bd-4c1266c16baf admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079397 Jan 17 21:18:18.315572 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 36/73] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jan 17 21:18:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:18:30.036761 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-09d00bfb-bbc9-4fe1-bc79-1f47bba3930f admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:18:30.037852 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-09d00bfb-bbc9-4fe1-bc79-1f47bba3930f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Jan 17 21:18:30.038248 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 38/74] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jan 17 21:18:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:18:30.234415 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-46c67d26-f1ac-48bc-90a5-485da21a8d42 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:18:30.235518 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:18:30.235518 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: warnings.warn(msg) Jan 17 21:18:30.237075 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-46c67d26-f1ac-48bc-90a5-485da21a8d42 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:18:30.237508 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-46c67d26-f1ac-48bc-90a5-485da21a8d42 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:18:30.238300 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-46c67d26-f1ac-48bc-90a5-485da21a8d42 admin admin] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:18:30.238727 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-46c67d26-f1ac-48bc-90a5-485da21a8d42 admin admin] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:18:30.263178 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-46c67d26-f1ac-48bc-90a5-485da21a8d42 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079998 Jan 17 21:18:30.263765 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 37/75] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jan 17 21:18:30 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:18:31.536790 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: DEBUG nova.api.openstack.wsgi [None req-09d00bfb-bbc9-4fe1-bc79-1f47bba3930f admin admin] Calling method '>' {{(pid=101758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:18:31.537788 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: INFO nova.api.openstack.requestlog [None req-09d00bfb-bbc9-4fe1-bc79-1f47bba3930f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001612 Jan 17 21:18:31.538180 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: [pid: 101758|app: 0|req: 39/76] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jan 17 21:18:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:18:31.732094 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG nova.api.openstack.wsgi [None req-12372077-bd76-4474-b4e4-51b7796efa79 admin admin] Calling method '>' {{(pid=101759) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:18:31.733667 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:18:31.733667 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: warnings.warn(msg) Jan 17 21:18:31.735337 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-12372077-bd76-4474-b4e4-51b7796efa79 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:18:31.735784 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-12372077-bd76-4474-b4e4-51b7796efa79 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:18:31.736633 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-12372077-bd76-4474-b4e4-51b7796efa79 admin admin] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:18:31.737100 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: DEBUG oslo_concurrency.lockutils [None req-12372077-bd76-4474-b4e4-51b7796efa79 admin admin] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101759) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:18:31.758209 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: INFO nova.api.openstack.requestlog [None req-12372077-bd76-4474-b4e4-51b7796efa79 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078897 Jan 17 21:18:31.758788 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: [pid: 101759|app: 0|req: 38/77] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jan 17 21:18:31 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:19:30.075277 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: Mon Jan 17 21:19:30 2022 - graceful shutdown triggered... Jan 17 21:19:30.075419 dv-cinder-824895-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 17 21:19:30.076405 dv-cinder-824895-3-iscsi devstack@n-api.service[101758]: Gracefully killing worker 1 (pid: 101758)... Jan 17 21:19:30.076798 dv-cinder-824895-3-iscsi devstack@n-api.service[101759]: Gracefully killing worker 2 (pid: 101759)... Jan 17 21:19:31.077474 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: worker 1 buried after 1 seconds Jan 17 21:19:31.077474 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: worker 2 buried after 1 seconds Jan 17 21:19:31.077474 dv-cinder-824895-3-iscsi devstack@n-api.service[101757]: goodbye to uWSGI. Jan 17 21:19:31.078962 dv-cinder-824895-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 17 21:19:31.079517 dv-cinder-824895-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 17 21:19:31.082225 dv-cinder-824895-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 17 21:19:31.098810 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 17 21:19:31.100806 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 17 21:19:31 2022] *** Jan 17 21:19:31.100806 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 17 21:19:31.100806 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 17 21:19:31.100806 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: nodename: dv-cinder-824895-3-iscsi Jan 17 21:19:31.100806 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: machine: x86_64 Jan 17 21:19:31.100806 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: clock source: unix Jan 17 21:19:31.100806 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: pcre jit disabled Jan 17 21:19:31.100806 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: detected number of CPU cores: 4 Jan 17 21:19:31.100806 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: current working directory: / Jan 17 21:19:31.100806 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: detected binary path: /usr/bin/uwsgi-core Jan 17 21:19:31.101576 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: your processes number limit is 47680 Jan 17 21:19:31.101576 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: your memory page size is 4096 bytes Jan 17 21:19:31.101576 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: detected max file descriptor number: 2048 Jan 17 21:19:31.101576 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: lock engine: pthread robust mutexes Jan 17 21:19:31.101576 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: thunder lock: enabled Jan 17 21:19:31.101576 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 17 21:19:31.101576 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 17 21:19:31.149063 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: Python main interpreter initialized at 0x56508083f9c0 Jan 17 21:19:31.149063 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: python threads support enabled Jan 17 21:19:31.149063 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: your server socket listen backlog is limited to 100 connections Jan 17 21:19:31.149063 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: your mercy for graceful operations on workers is 90 seconds Jan 17 21:19:31.149509 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: mapped 403077 bytes (393 KB) for 2 cores Jan 17 21:19:31.149586 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: *** Operational MODE: preforking *** Jan 17 21:19:31.149851 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: *** uWSGI is running in multiple interpreter mode *** Jan 17 21:19:31.149851 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: spawned uWSGI master process (pid: 116170) Jan 17 21:19:31.150053 dv-cinder-824895-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 17 21:19:31.151282 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: spawned uWSGI worker 1 (pid: 116182, cores: 1) Jan 17 21:19:31.151282 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: spawned uWSGI worker 2 (pid: 116183, cores: 1) Jan 17 21:19:31.151282 dv-cinder-824895-3-iscsi devstack@n-api.service[116170]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 17 21:19:33.182962 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 21:19:33.182962 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: from cryptography.utils import int_from_bytes Jan 17 21:19:33.184078 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 21:19:33.184078 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: from cryptography.utils import int_from_bytes Jan 17 21:19:33.192057 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 21:19:33.192057 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: from cryptography.utils import int_from_bytes Jan 17 21:19:33.192729 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 17 21:19:33.192729 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: from cryptography.utils import int_from_bytes Jan 17 21:19:35.600571 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 17 21:19:35.601291 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 17 21:19:35.601430 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 17 21:19:35.601713 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 17 21:19:35.601947 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 17 21:19:35.602350 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.602680 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.603008 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.603332 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.603665 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.603980 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.605015 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.605268 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.605604 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.605871 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.606194 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.606525 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824895-3-iscsi {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.606853 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.607165 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.607481 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.607806 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.608115 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.608577 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.608777 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.609288 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.610695 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.610695 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.610695 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.610970 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.611292 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.611602 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.611926 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.612245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.612605 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.612935 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.613335 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824895-3-iscsi {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.613661 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.614060 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.614299 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.614721 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.615042 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.615352 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.615674 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.616002 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.616329 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.616686 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.617022 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.617339 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.617668 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.617980 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.618298 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.618628 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.618947 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.619262 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.619577 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.620435 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.620867 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.621234 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.621641 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.621980 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.622258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.622509 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.622835 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.623164 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.623482 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.623801 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 17 21:19:35.624235 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.624332 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 17 21:19:35.624605 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.624605 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.624781 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 17 21:19:35.624860 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.624947 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 17 21:19:35.625027 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.625212 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 17 21:19:35.625319 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.625577 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.625687 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.625906 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.626018 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.626234 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.626346 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.626562 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.626662 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.626984 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.627077 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.627255 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.627382 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.627544 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.627694 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.627852 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.627956 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.628174 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.628262 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.628516 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.628654 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.628731 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.628986 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.629133 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824895-3-iscsi {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.629315 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.629618 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.629784 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.629940 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.629940 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.630232 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.630385 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.630542 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.630774 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.630930 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.631082 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.631234 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.631387 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.631564 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.631564 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.631874 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.632077 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.632233 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.632414 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.632597 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.632745 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.632915 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.633068 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.633244 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.633401 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.633583 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.633738 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.633895 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.634060 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.634223 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.634378 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.634524 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.634676 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.634821 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.634972 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.635124 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.635279 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.635451 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824895-3-iscsi {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.636226 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.636419 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.636586 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.636767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.636931 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.636931 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.637220 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.637366 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.637520 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.637667 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.637824 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.637970 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.638125 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.638814 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.641799 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.641984 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.642844 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.643010 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.643175 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.643331 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.643496 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.643695 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.643890 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.644042 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.644194 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.644482 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.644644 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.645002 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.645167 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.645335 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.645919 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.646076 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.646221 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.646366 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.646526 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.646672 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.646817 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.646967 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.647112 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.647264 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.647423 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.647569 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.647731 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.647883 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.648027 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.648182 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.648337 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.648524 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.648671 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.648820 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.648974 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.648974 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.649461 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.649631 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.649806 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.650048 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.650206 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.650365 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.650518 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.650670 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.650822 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.650966 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.651657 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.651810 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.651960 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.652104 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.652278 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.652853 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.653030 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.653185 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.653330 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.653481 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.653633 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.653788 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.653946 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.654098 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.654243 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.654398 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.654553 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.654717 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.654875 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.655028 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.655172 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.655316 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.655466 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.655624 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.655770 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.655932 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.656269 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.656456 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.656621 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.656799 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.656945 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.657089 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.657240 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.657385 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.657535 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.657693 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.657850 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.657995 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.657995 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.658273 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.658418 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.658574 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.658740 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.658898 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.659043 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.659194 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.660118 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.660279 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.660444 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.660594 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.660739 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.660884 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.661045 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.661201 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.661384 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.661552 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.661708 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.661853 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.662014 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.662166 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.662312 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.662467 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.663088 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.663246 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.663478 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.663625 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.663769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.663933 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.664089 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.664247 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.664439 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.664439 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.664731 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.664883 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.665027 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.665187 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.665377 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.665535 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.665686 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.665841 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.665996 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.666159 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.666460 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.666615 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.667457 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.667616 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.667769 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.667924 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.668077 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.668234 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.668416 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.668584 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.668751 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.668910 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.669055 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.669205 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.669364 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.669699 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.669867 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.670025 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.670170 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.670331 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.670482 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.670635 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.670780 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.670923 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.671077 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.671232 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.671388 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.671540 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.671696 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.671849 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.672008 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.672152 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.672303 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.672510 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.672670 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.673213 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.673420 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.673586 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.673739 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.673895 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.673895 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.674169 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.674312 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.674472 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.674626 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.674771 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.674915 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.675066 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.675223 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.675392 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.675539 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.675692 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.675844 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.675998 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.676143 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.676301 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.676570 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.676724 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.676869 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.677027 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.677188 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.677334 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.677605 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.677767 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.677914 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 17 21:19:35.678068 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.678229 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.678383 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.678539 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.678685 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.678831 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.678982 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.679139 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.679292 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.679445 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.679766 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.679936 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.680093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.680239 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.680409 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.680560 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.680716 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.680869 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.681030 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.681193 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.681469 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.681629 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.681785 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.681938 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.682098 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.682251 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.682403 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.682565 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.682710 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.682853 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.683286 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.683512 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.683673 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.683826 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.683971 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.684135 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.684289 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.684453 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.684613 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.684765 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.684919 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.685079 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.685232 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.685377 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.685536 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.685635 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.685741 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.685835 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.685916 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.686008 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.686107 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.686199 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.686292 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.686392 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.686485 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.687254 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.687365 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.687461 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.687648 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.687749 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.687845 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.687940 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.688034 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.688127 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.688226 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.688325 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.688583 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.688697 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.688786 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.688878 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.688979 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.689066 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.689150 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.689234 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.689318 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.689410 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.689510 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.689596 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.689702 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.689951 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.690062 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.690158 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.690258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.690344 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.690429 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.690521 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.690606 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.690704 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.690790 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.690899 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.690992 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.691078 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.691169 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.691272 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.691366 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.691654 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.691760 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.691855 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.691949 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.692048 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.692135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.692226 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.692319 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.692432 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.692522 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.692625 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.692625 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.692791 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.692791 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.692791 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.692791 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.692791 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.693457 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.693561 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.693655 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.693748 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.693748 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.693913 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.694007 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.694007 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.694007 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.694233 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.694327 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.694327 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.694327 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.694327 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.694622 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.694708 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.694708 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.694708 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.694708 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.695024 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.695115 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.695115 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.695115 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.695348 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.695440 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.695440 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.695440 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.695440 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.695734 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.695820 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.695820 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.695820 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.696035 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.696135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.696135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.696135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.696135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.696135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.696135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.696135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.696663 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.696757 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.696843 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.697129 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.697432 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.697539 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.697738 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.698672 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.698780 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.698925 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.699180 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.699282 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.699532 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.699786 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.699895 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.700181 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.700429 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.700541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.700838 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.701047 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.701163 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.701491 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.701631 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.701880 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.702130 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.702274 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.702451 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.702775 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.702868 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.703104 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.703460 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.703578 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.703722 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.703968 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.704070 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.704341 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.704592 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.704686 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.704983 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.705174 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.705312 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.705629 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.705729 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.705948 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.706247 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.706350 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.706563 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.706843 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.706947 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.707190 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.707493 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.707773 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.707946 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.708110 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.708453 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.708561 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.708810 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.709052 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.709156 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.709409 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.709639 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.709733 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.710231 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.710337 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.710434 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.711103 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.711217 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.711306 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.711403 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.711500 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.711601 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.711822 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.711930 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.712165 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.712441 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.712538 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.712800 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.713063 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.713165 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.713409 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.714288 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.714397 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.714630 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.714915 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.715008 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.715248 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.715529 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.715877 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.716116 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.716500 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.716613 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.716768 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.717026 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.717127 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.717382 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.717643 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.717751 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.717985 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.718222 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.718316 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.718630 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.718823 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.719029 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.719305 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.719398 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.719735 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.719907 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.720049 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.720364 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.720481 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.720720 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.721022 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.721127 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.721330 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.721627 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.721729 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.721958 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.722231 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.722335 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.722567 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.722824 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.722917 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.723189 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.723427 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.723542 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.723853 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.724032 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.724135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.724413 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.724658 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.724753 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.725036 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.725238 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.725340 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.725643 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.725831 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.725935 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.726251 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.726563 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.726666 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.726869 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.727179 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.727273 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.727486 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.727786 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.727900 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.728098 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.728404 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.728513 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.728725 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.728986 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.729094 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.729396 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.729620 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.729715 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.730019 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.730204 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.730321 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.730633 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.730793 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.730943 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.731262 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.731354 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.731573 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.731875 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.731977 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.732189 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.732497 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.732615 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.732853 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.733103 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.733203 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.733463 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.733699 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.734020 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.734136 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.734287 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.734382 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.734660 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.734890 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.734984 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.735259 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.735474 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.735567 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.735861 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.736065 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.736172 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.736501 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.736777 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.736880 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.737113 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.737374 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.737491 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.737717 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.737992 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.738107 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.738722 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.738816 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.738903 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.738996 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.739246 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.739349 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.739606 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.739841 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.739945 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.740286 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.740454 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.740727 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.740864 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.741048 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.741170 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.741486 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.741639 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.741806 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.742118 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.742209 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.742493 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.742724 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.742829 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.743058 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.743320 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.743414 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.743683 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.743907 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.744272 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.744417 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.744508 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.744643 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.745012 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.745117 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.745948 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.746056 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.746130 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.746200 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.746279 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.746279 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.746532 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.746736 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.746841 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.747148 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.747321 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.747462 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.747783 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.748106 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.748407 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.748689 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.748798 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.749030 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.749286 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.749378 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.749705 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.749889 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.749998 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.750268 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.750504 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.750601 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.750893 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.751318 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.751443 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.751605 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.751705 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.751921 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.752220 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.752312 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.752800 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.752903 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.753002 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.753271 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.753384 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.753471 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.753784 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.753883 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.754094 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.754333 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.754511 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.754726 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.754833 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.755053 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.755155 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.755378 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.755479 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.755715 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.755807 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.756022 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.756120 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.756336 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.756480 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.756688 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.756782 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.756998 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.757095 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.757307 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.757397 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.757616 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.757707 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.757944 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.758041 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.758255 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.758358 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.758581 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.758680 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.758953 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.759092 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.759274 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.759418 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.759590 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.759724 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.759911 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.760023 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.760232 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.760337 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.761152 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.761246 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.761429 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.761529 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.761752 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.761847 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.762076 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.762169 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.762397 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.762564 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.762712 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.762812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.763025 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.763124 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.763348 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.763447 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.763674 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.763947 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.764040 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.764290 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.764588 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.764700 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.764797 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.764936 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.765031 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.765264 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.765377 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.765584 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.765687 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.765911 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.766012 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.766254 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.766355 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.766661 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.766767 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.766862 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.766956 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.767167 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.767261 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.767482 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.767584 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.767795 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.767990 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.768114 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.768208 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.768460 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.768559 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.768767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.768859 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.769074 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.769180 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.769390 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.769489 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.769698 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.769796 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.770009 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.770133 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.770317 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.770418 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.770632 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.770724 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.770941 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.771044 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.771250 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.771348 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.771572 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.771676 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.771880 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.771970 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.772201 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.772298 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.772552 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.772645 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.772867 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.772977 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.773181 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.773321 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.773486 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.773618 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.773808 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.773937 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.774121 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.774238 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.774431 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.774754 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.774895 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.775031 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.775160 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.775929 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.776864 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.777045 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.777197 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.777346 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.777507 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.777665 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.777665 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.777963 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.778205 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.778366 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.778524 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.778687 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.778956 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.779112 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.779261 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.779418 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.779573 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.779751 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.779901 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.780118 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.780276 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.780454 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.780623 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.780779 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.780927 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.781074 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.781074 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.781351 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.781508 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.781663 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.781822 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.781969 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.782123 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.782270 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.782430 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.782588 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.782736 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.782916 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.783077 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.783225 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.783445 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.783596 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.783761 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.783929 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.784084 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.784241 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.784419 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.784585 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.784841 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.785003 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.785152 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.785309 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.785533 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.785684 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.785839 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.786004 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.786152 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.786314 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.786462 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.786618 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.786767 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.786922 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.787076 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.787237 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.787385 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.787531 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.787677 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.787824 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.787982 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.788142 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.788324 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.788489 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.788611 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.788716 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.788824 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.788919 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.789001 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.789081 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.789154 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.789237 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.789335 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.789421 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.789505 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.789596 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.789682 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.789773 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.789868 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.789955 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.790038 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.790122 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.790212 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.790305 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.790404 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.790498 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.790498 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.790669 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.790762 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.790928 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.791033 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.791248 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.791374 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.791660 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.791764 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.791867 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.791962 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.792186 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.792280 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.792524 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.792620 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.792837 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.792940 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.793153 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.793267 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.793458 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.793564 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.793770 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.793871 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.794103 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.794205 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.794433 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.794536 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.794760 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.794858 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.795081 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.795184 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.795405 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.795505 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.795720 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.795813 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.796039 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.796158 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.796355 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.796478 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.796755 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.796856 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.797101 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.797290 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.797447 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.797598 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.797754 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.797910 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.798071 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.798226 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.798394 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.798558 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.798714 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.798862 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.799022 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.799197 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.799348 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.799503 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.799659 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.799815 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.799972 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.800121 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.800269 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.800480 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.800635 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.800783 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.800957 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.801106 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.801252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.801425 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.801425 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.801719 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.801876 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.802045 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.802209 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.802394 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.802544 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.802700 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.802858 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.803006 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.803151 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.803298 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.803444 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.803664 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.803821 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.803977 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.804132 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.804287 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.804501 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.804655 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.804810 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.804810 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.805133 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.805288 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.805445 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.805594 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.805748 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.805895 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.806067 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.806225 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.806381 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.806553 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.806710 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.806864 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.807012 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.807165 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.807346 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.807346 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.807630 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.807786 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.807942 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.808098 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.808246 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.808413 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.808578 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.808737 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.808885 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.808885 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.809180 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.809328 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.809474 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.809627 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.809774 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.809929 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.810084 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.810237 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.810400 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.810547 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.810700 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.810857 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.811013 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.811168 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.811322 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.811468 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.811629 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.811777 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.811924 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.812077 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.812230 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.812406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.812647 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.812812 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.812962 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.813109 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.813256 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.813402 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.813562 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.813711 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.813857 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.814004 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.814159 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.814307 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.814474 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.814474 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.814762 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.814909 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.815055 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.815215 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.815364 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.815517 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.815664 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.815819 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.815973 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.816136 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.816300 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.816474 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.816633 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.816781 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.816927 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.817097 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.817255 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.817404 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.817550 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.817697 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.817852 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.818013 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.818169 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.818335 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.818493 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.818641 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.818800 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.818948 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.819095 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.819241 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.819387 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.819540 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.819696 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.819850 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.819850 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.820149 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.820316 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.820500 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.820663 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.820819 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.820965 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.821112 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.821258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.821406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.821563 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.821717 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.821872 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.822020 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.822166 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.822337 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.822493 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.822641 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.822789 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.823459 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.823620 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.823782 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.823930 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.824078 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.824284 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.824490 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.824651 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.824824 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.824972 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.825127 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.825282 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.825437 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.825593 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.825751 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.825913 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.826068 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.826233 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.826391 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.826550 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.826698 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.826856 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.827012 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.827168 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.827323 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.827481 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.827638 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.827795 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.827951 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.828107 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.828262 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.828480 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.828645 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.828801 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.828968 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.829119 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.829278 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.829426 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.829573 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.829730 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.829878 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.830036 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.830193 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.830340 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.830496 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.830649 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.830809 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.830957 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.831119 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.831269 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.831416 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.831563 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.831722 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.831872 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.832033 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.832033 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.832323 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.832550 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.832709 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.832880 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.833031 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.833178 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.833335 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.833492 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.833647 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.833647 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.833957 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.834106 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.834260 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.834416 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.834564 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.834731 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.834887 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.835043 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.835201 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.835356 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.835575 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.835725 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.835882 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.836040 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.836188 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.836335 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.836523 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.836673 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.836832 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.836987 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.837144 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.837293 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.837448 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.837597 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.837754 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.837910 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.838058 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.838220 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.838376 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.838555 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.839299 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.839449 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.839605 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.839773 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.839922 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.840069 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.840230 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.840406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.840561 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.840980 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.841131 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.841279 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.841426 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.841583 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.841731 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.841888 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.842037 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.842185 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.842334 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.842488 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.842645 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.842801 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.842950 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.843099 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.843245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.843400 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.843641 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.843801 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.843957 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.844113 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.844260 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.844470 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.844645 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.844795 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.844942 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.845089 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.845249 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.845405 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.845574 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.845724 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.845871 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.846018 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.846164 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.846320 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.846469 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.846469 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.846757 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.846904 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.847059 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.847222 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.847379 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.847547 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.847703 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.847858 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.848006 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.848163 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.848311 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.848496 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.848647 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.848795 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.848952 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.849101 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.849520 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.849697 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.849846 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.850003 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.850167 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.850325 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.850481 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.850643 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.850793 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.850942 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.851102 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.851252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.851399 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.851547 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.851707 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.851869 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.852017 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.852165 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.852321 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.852499 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.852618 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.852725 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.852825 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.852916 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.853002 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.853103 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.853191 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.853286 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.853374 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.853468 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.853554 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.853651 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 17 21:19:35.853769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.853991 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.854339 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.854665 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.854985 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.855352 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.855623 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.855945 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.856267 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.856633 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.856976 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.857302 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.857625 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.857953 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.858272 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.858798 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.859118 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.859457 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.859788 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.860119 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.860475 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.860803 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.861134 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.861444 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.861754 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.862070 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.862384 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.862693 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.863019 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.863336 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.863644 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.863970 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.864291 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.864858 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.865212 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.865649 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.865900 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.866231 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.866556 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.866867 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.867196 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.867508 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.867818 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.868139 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.868494 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.868808 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.869118 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.869435 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.869750 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.870082 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.870399 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.870707 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.871038 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.871351 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.871767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.872083 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.872607 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.872729 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.873039 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.873360 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.873664 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.873969 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.874285 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.874603 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.874913 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.875228 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.875539 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.875855 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.876180 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.876518 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.876799 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_db.sqlalchemy.engines [None req-5483e979-ea81-4a96-b902-c3586c83aca0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116183) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:19:35.876969 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.877130 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.877432 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.877772 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.878081 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.878400 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.878718 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.879085 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.879406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.879983 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.880407 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.880738 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.881094 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.881446 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.881762 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.882076 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.882391 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.882732 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.883161 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.883355 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.883674 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.883991 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.884315 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.884658 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.884975 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.885291 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.886146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.886470 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.886822 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.887152 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.887475 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.887797 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.888123 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.888464 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.888784 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.889101 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.889420 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.889741 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.890085 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.890407 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.890722 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.891148 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.891466 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.891792 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.892119 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.892500 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.892782 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.893110 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.893425 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.893754 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.894073 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.894407 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.894756 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.895090 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.895421 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.895734 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.896077 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.896540 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.896685 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.897015 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.897356 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.897676 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.898003 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.898321 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.898649 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.898966 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.899294 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.899622 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.899948 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.900265 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.900642 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.900965 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.901876 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.902198 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.902517 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.902836 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.903155 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.903490 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.903822 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.904142 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.904497 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.904824 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.905152 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.905480 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.905845 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.906181 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.906499 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.906821 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.907138 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.907455 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.907781 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.908103 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.908456 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.908790 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.909123 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.909457 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.909820 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.910140 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.910491 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.910824 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.911146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.911466 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.911775 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 17 21:19:35.912026 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 17 21:19:35.934849 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_db.sqlalchemy.engines [None req-a53aee8c-e4f0-4ef1-9747-dac3c2c4fee0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116182) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:19:35.943279 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.context [None req-5483e979-ea81-4a96-b902-c3586c83aca0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c701e1f9-5e14-4d1d-beb5-81eb20dd71e0(cell1) {{(pid=116183) load_cells /opt/stack/nova/nova/context.py:464}} Jan 17 21:19:35.947541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5483e979-ea81-4a96-b902-c3586c83aca0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:19:35.949731 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5483e979-ea81-4a96-b902-c3586c83aca0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:19:35.950573 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5483e979-ea81-4a96-b902-c3586c83aca0 None None] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:19:35.952531 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5483e979-ea81-4a96-b902-c3586c83aca0 None None] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:19:35.963111 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_db.sqlalchemy.engines [None req-5483e979-ea81-4a96-b902-c3586c83aca0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116183) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:19:35.966690 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_db.sqlalchemy.engines [None req-5483e979-ea81-4a96-b902-c3586c83aca0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116183) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:19:36.003022 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.context [None req-a53aee8c-e4f0-4ef1-9747-dac3c2c4fee0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c701e1f9-5e14-4d1d-beb5-81eb20dd71e0(cell1) {{(pid=116182) load_cells /opt/stack/nova/nova/context.py:464}} Jan 17 21:19:36.007287 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a53aee8c-e4f0-4ef1-9747-dac3c2c4fee0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:19:36.009041 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a53aee8c-e4f0-4ef1-9747-dac3c2c4fee0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:19:36.009966 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a53aee8c-e4f0-4ef1-9747-dac3c2c4fee0 None None] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:19:36.012210 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a53aee8c-e4f0-4ef1-9747-dac3c2c4fee0 None None] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:19:36.024672 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_db.sqlalchemy.engines [None req-a53aee8c-e4f0-4ef1-9747-dac3c2c4fee0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116182) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:19:36.025557 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_db.sqlalchemy.engines [None req-a53aee8c-e4f0-4ef1-9747-dac3c2c4fee0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116182) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:19:36.129675 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_db.sqlalchemy.engines [None req-5483e979-ea81-4a96-b902-c3586c83aca0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116183) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:19:36.196030 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_db.sqlalchemy.engines [None req-a53aee8c-e4f0-4ef1-9747-dac3c2c4fee0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116182) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 17 21:19:36.578805 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: WARNING keystonemiddleware.auth_token [None req-5483e979-ea81-4a96-b902-c3586c83aca0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 21:19:36.585807 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: WARNING keystonemiddleware.auth_token [None req-5483e979-ea81-4a96-b902-c3586c83aca0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 21:19:36.636524 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: WARNING keystonemiddleware.auth_token [None req-a53aee8c-e4f0-4ef1-9747-dac3c2c4fee0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 21:19:36.643698 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: WARNING keystonemiddleware.auth_token [None req-a53aee8c-e4f0-4ef1-9747-dac3c2c4fee0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 21:19:36.814767 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: WARNING keystonemiddleware.auth_token [None req-5483e979-ea81-4a96-b902-c3586c83aca0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 21:19:36.820029 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: WARNING keystonemiddleware.auth_token [None req-5483e979-ea81-4a96-b902-c3586c83aca0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 21:19:36.826130 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56508083f9c0 pid: 116183 (default app) Jan 17 21:19:36.875398 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: WARNING keystonemiddleware.auth_token [None req-a53aee8c-e4f0-4ef1-9747-dac3c2c4fee0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 17 21:19:36.880611 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: WARNING keystonemiddleware.auth_token [None req-a53aee8c-e4f0-4ef1-9747-dac3c2c4fee0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 17 21:19:36.886011 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56508083f9c0 pid: 116182 (default app) Jan 17 21:20:11.949071 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a08203e4-2ef3-41ef-912b-53d7cecd4212 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Action: 'create', calling method: .version_select at 0x7f8977fb61f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1012128281"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:20:12.680499 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4b177d53-5c2b-44c4-a5a6-838391a8d1f8 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] Action: 'create', calling method: .version_select at 0x7f8977fb61f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1578110408", "metadata": {"Type": "work"}}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:20:13.367413 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a08203e4-2ef3-41ef-912b-53d7cecd4212 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.888995 Jan 17 21:20:13.368866 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1154 bytes} [Mon Jan 17 21:20:10 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2892 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 17 21:20:13.382799 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7a794c9e-691c-4897-8f24-911c2db1ce5b tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8977e78dc0>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:14.126656 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7a794c9e-691c-4897-8f24-911c2db1ce5b tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe" status: 200 len: 345 microversion: 2.1 time: 0.749431 Jan 17 21:20:14.127240 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 2/2] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:13 2022] GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe => generated 345 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:14.131365 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3a98b353-bcf1-45e4-b82b-8072c209946f tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] Calling method '.version_select at 0x7f8977e78e50>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:14.247040 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3a98b353-bcf1-45e4-b82b-8072c209946f tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/834a3066-4fed-4b68-b512-e1c9b3e5d585" status: 200 len: 351 microversion: 2.1 time: 0.118818 Jan 17 21:20:14.247607 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 3/3] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:14 2022] GET /compute/v2.1/os-volumes/834a3066-4fed-4b68-b512-e1c9b3e5d585 => generated 351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:14.399856 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4b177d53-5c2b-44c4-a5a6-838391a8d1f8 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.147712 Jan 17 21:20:14.400679 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 1/4] 10.222.0.64 () {60 vars in 1155 bytes} [Mon Jan 17 21:20:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3150 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 17 21:20:14.414295 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-325c7b33-683c-4375-b403-97e09551bf1b tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] Calling method '.version_select at 0x7f8977e75dc0>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:14.512949 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-325c7b33-683c-4375-b403-97e09551bf1b tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d" status: 200 len: 353 microversion: 2.1 time: 0.104271 Jan 17 21:20:14.513802 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 2/5] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:14 2022] GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:20:14.733030 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1194706760", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452", "networks": [{"uuid": "af5d6d41-8980-4578-bea9-2653deda4e23"}]}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:20:14.880318 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.network.neutron [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] validate_networks() for [('af5d6d41-8980-4578-bea9-2653deda4e23', None, None, None, None, None)] {{(pid=116183) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:20:15.139783 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d9b21a26-ddf9-490c-b1a4-c3caeff51d8b tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8977e75e50>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:15.201243 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d9b21a26-ddf9-490c-b1a4-c3caeff51d8b tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe" status: 200 len: 346 microversion: 2.1 time: 0.065242 Jan 17 21:20:15.201955 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 3/6] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:15 2022] GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:15.214720 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7cb8995e-98ad-404d-869f-9f239e443f80 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Action: 'create', calling method: .version_select at 0x7f8977e0b790>, body: {"snapshot": {"volume_id": "ca1255f2-fbf2-4f54-a605-3c750bd47bbe", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-97889217"}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:20:15.644929 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7cb8995e-98ad-404d-869f-9f239e443f80 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.433693 Jan 17 21:20:15.647377 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 4/7] 10.222.0.64 () {60 vars in 1161 bytes} [Mon Jan 17 21:20:15 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:15.654257 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-82a60804-3d48-40bf-bfa0-ec217d3625b8 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] Calling method '.version_select at 0x7f8977e113a0>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:15.753046 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-82a60804-3d48-40bf-bfa0-ec217d3625b8 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d" status: 200 len: 354 microversion: 2.1 time: 0.104419 Jan 17 21:20:15.758494 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 5/8] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:15 2022] GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:15.772109 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-24d25a22-ed71-43f4-85f1-1d715e64a1b8 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8977e0bdc0>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:15.859965 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-24d25a22-ed71-43f4-85f1-1d715e64a1b8 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b" status: 200 len: 285 microversion: 2.1 time: 0.099153 Jan 17 21:20:15.860691 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 6/9] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jan 17 21:20:15 2022] GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:15.871924 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-51899acb-c153-489a-a228-d65ae22bccc1 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] Calling method '.version_select at 0x7f8977e0b430>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:15.886977 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Flavor limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:20:15.887541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Image limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:20:15.887997 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Flavor pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:20:15.888619 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Image pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:20:15.889263 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:20:15.921685 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:15.922076 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:15.925429 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:15.929072 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:15.950934 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-51899acb-c153-489a-a228-d65ae22bccc1 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d" status: 200 len: 354 microversion: 2.1 time: 0.086296 Jan 17 21:20:15.952929 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 7/10] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:15 2022] GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:15.983694 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b681c511-28d1-4348-9bb7-ad0f2947eb15 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] Calling method '.version_select at 0x7f8977e11b80>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:15.984475 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Getting quotas for project 3d304e800c1c44a5ae9dd3e05253a278. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:20:16.019378 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Getting quotas for user 8a9190e92a314e5a8ca646fc9f972a66 and project 3d304e800c1c44a5ae9dd3e05253a278. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:20:16.046361 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Going to run 1 instances... {{(pid=116183) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:20:16.061603 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:20:16.134567 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b681c511-28d1-4348-9bb7-ad0f2947eb15 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/b6d3d7dc-bc6c-4f52-9aa6-330b446743c3" status: 200 len: 351 microversion: 2.1 time: 0.180223 Jan 17 21:20:16.135664 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 8/11] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:15 2022] GET /compute/v2.1/os-volumes/b6d3d7dc-bc6c-4f52-9aa6-330b446743c3 => generated 351 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:16.140535 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5f6abdc6-2f05-4038-b357-5c7d23eaac0d tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8977e75ee0>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:16.261410 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-30505b97-63e4-4621-af7d-b9c31646fd6e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.012691 Jan 17 21:20:16.262089 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 4/12] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:20:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:20:16.266916 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-dd4b9362-d89f-49af-a09c-2c72aad8ca47 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] Calling method '.version_select at 0x7f8977d85430>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:16.285441 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5f6abdc6-2f05-4038-b357-5c7d23eaac0d tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.148267 Jan 17 21:20:16.286038 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 9/13] 10.222.0.64 () {58 vars in 1139 bytes} [Mon Jan 17 21:20:16 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:16.298039 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e0825bcc-d45e-4cd2-9b18-d8874a10b0e0 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:16.298789 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e0825bcc-d45e-4cd2-9b18-d8874a10b0e0 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:16.433671 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-dd4b9362-d89f-49af-a09c-2c72aad8ca47 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d" status: 202 len: 0 microversion: 2.1 time: 0.170047 Jan 17 21:20:16.434996 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 5/14] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jan 17 21:20:16 2022] DELETE /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:20:16.441137 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-48823ae8-834a-4853-b1bb-bc2a402e4293 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8977d855e0>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:16.518176 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-48823ae8-834a-4853-b1bb-bc2a402e4293 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b" status: 200 len: 285 microversion: 2.1 time: 0.081836 Jan 17 21:20:16.519134 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 6/15] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jan 17 21:20:16 2022] GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b => generated 285 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:16.526150 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ef182a3f-f505-4a8f-9d9f-f4420216684a tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] Calling method '.version_select at 0x7f8977d85670>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:16.645563 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-e0825bcc-d45e-4cd2-9b18-d8874a10b0e0 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:16.646598 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ef182a3f-f505-4a8f-9d9f-f4420216684a tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d" status: 200 len: 353 microversion: 2.1 time: 0.126188 Jan 17 21:20:16.647170 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 7/16] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:16 2022] GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d => generated 353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:16.681077 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e0825bcc-d45e-4cd2-9b18-d8874a10b0e0 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1215 microversion: 2.1 time: 0.386730 Jan 17 21:20:16.685683 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 10/17] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:16 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1215 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:17.530417 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c0bc6ac2-50b5-4e12-b35c-1ece655ed445 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8977522790>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:17.654438 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c0bc6ac2-50b5-4e12-b35c-1ece655ed445 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b" status: 200 len: 285 microversion: 2.1 time: 0.127659 Jan 17 21:20:17.655501 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 8/18] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jan 17 21:20:17 2022] GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:17.659746 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-9e9d0153-2b4f-4b4c-9d3f-d5f352a15373 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] Calling method '.version_select at 0x7f8977e0be50>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:17.701639 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8859fa82-f5bf-44f0-b00c-44ee44e2ce4a tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:17.702657 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8859fa82-f5bf-44f0-b00c-44ee44e2ce4a tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:17.769053 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-9e9d0153-2b4f-4b4c-9d3f-d5f352a15373 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d" status: 200 len: 353 microversion: 2.1 time: 0.113778 Jan 17 21:20:17.770060 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 11/19] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:17 2022] GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:20:17.937648 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8859fa82-f5bf-44f0-b00c-44ee44e2ce4a tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:17.951488 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8859fa82-f5bf-44f0-b00c-44ee44e2ce4a tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1215 microversion: 2.1 time: 0.253548 Jan 17 21:20:17.952346 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 9/20] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:17 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1215 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:18.665395 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-29ec1cc9-806a-4708-8d84-9e70b3585812 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8977dd7d30>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:18.714622 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-29ec1cc9-806a-4708-8d84-9e70b3585812 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b" status: 200 len: 285 microversion: 2.1 time: 0.052773 Jan 17 21:20:18.715178 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 12/21] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jan 17 21:20:18 2022] GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b => generated 285 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:18.783748 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-63d41a5c-0a6c-4db7-abdb-e1b1e52a4b31 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] Calling method '.version_select at 0x7f8977d85d30>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:18.862050 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-63d41a5c-0a6c-4db7-abdb-e1b1e52a4b31 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d" status: 200 len: 353 microversion: 2.1 time: 0.084152 Jan 17 21:20:18.862621 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 10/22] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:18 2022] GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:18.969601 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-80e7393b-146a-466a-8dda-2e80ca7c6faa tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:18.970546 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-80e7393b-146a-466a-8dda-2e80ca7c6faa tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:18.979899 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-80e7393b-146a-466a-8dda-2e80ca7c6faa tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:18.980731 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-80e7393b-146a-466a-8dda-2e80ca7c6faa tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:18.981762 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-80e7393b-146a-466a-8dda-2e80ca7c6faa tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:18.982278 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-80e7393b-146a-466a-8dda-2e80ca7c6faa tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:19.239682 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-80e7393b-146a-466a-8dda-2e80ca7c6faa tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:19.255322 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-80e7393b-146a-466a-8dda-2e80ca7c6faa tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1219 microversion: 2.1 time: 0.289577 Jan 17 21:20:19.256981 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 13/23] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:18 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1219 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:19.725707 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3c8f3561-fa34-4055-b860-dcb380a60f81 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8977d5f8b0>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:19.756766 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3c8f3561-fa34-4055-b860-dcb380a60f81 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b" status: 200 len: 285 microversion: 2.1 time: 0.034651 Jan 17 21:20:19.761303 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 14/24] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jan 17 21:20:19 2022] GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b => generated 285 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:19.875990 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c308400f-9808-449c-83e7-5254d753c329 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] Calling method '.version_select at 0x7f8977d68310>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:19.940876 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c308400f-9808-449c-83e7-5254d753c329 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d" status: 200 len: 353 microversion: 2.1 time: 0.069864 Jan 17 21:20:19.941651 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 15/25] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:19 2022] GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:20.045531 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-191048422", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bff8e5f5-97ad-489f-85ec-9f479ea549b7"}]}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:20:20.105210 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.network.neutron [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] validate_networks() for [('bff8e5f5-97ad-489f-85ec-9f479ea549b7', None, None, None, None, None)] {{(pid=116183) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:20:20.276267 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a36b4e33-f579-4fb7-972d-6b39e03e6a42 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:20.279198 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a36b4e33-f579-4fb7-972d-6b39e03e6a42 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:20.318956 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a36b4e33-f579-4fb7-972d-6b39e03e6a42 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:20.319708 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a36b4e33-f579-4fb7-972d-6b39e03e6a42 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:20.321058 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a36b4e33-f579-4fb7-972d-6b39e03e6a42 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:20.322447 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a36b4e33-f579-4fb7-972d-6b39e03e6a42 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:20.524159 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a36b4e33-f579-4fb7-972d-6b39e03e6a42 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:20.536890 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a36b4e33-f579-4fb7-972d-6b39e03e6a42 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1219 microversion: 2.1 time: 0.266291 Jan 17 21:20:20.576919 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 16/26] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:20 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1219 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:20.768027 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-42e76efd-d488-4c3e-9eb6-ad344c342ec8 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8977d68430>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:20.814548 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-42e76efd-d488-4c3e-9eb6-ad344c342ec8 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b" status: 200 len: 285 microversion: 2.1 time: 0.049965 Jan 17 21:20:20.815430 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 17/27] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jan 17 21:20:20 2022] GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b => generated 285 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:20:20.820263 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Flavor limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:20:20.820720 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Image limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:20:20.821892 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Flavor pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:20:20.822313 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Image pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:20:20.822749 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:20:20.835707 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:20.836361 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:20.837940 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:20.838556 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:20.862799 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Getting quotas for project 090730c5b4bb4a7195d893aa312dcfe6. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:20:20.868689 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Getting quotas for user 62d1680b47584ecba63c0ff2ee7667c5 and project 090730c5b4bb4a7195d893aa312dcfe6. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:20:20.891388 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Going to run 1 instances... {{(pid=116183) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:20:20.895001 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:20:20.953268 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ee6238ff-b873-4694-8216-a35b74f48acc tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] Calling method '.version_select at 0x7f8977d5fd30>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:20.971541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-433582ac-4d50-4ca2-afab-1e5df5ec273d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.315238 Jan 17 21:20:20.972464 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 11/28] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:20:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:20:20.990941 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b10e979f-e0bd-423f-8463-3b10e62175fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:20.992772 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b10e979f-e0bd-423f-8463-3b10e62175fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:21.046689 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ee6238ff-b873-4694-8216-a35b74f48acc tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d" status: 200 len: 353 microversion: 2.1 time: 0.096930 Jan 17 21:20:21.052975 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 18/29] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:20 2022] GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:21.077431 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b10e979f-e0bd-423f-8463-3b10e62175fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:21.087345 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b10e979f-e0bd-423f-8463-3b10e62175fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1221 microversion: 2.1 time: 0.101440 Jan 17 21:20:21.088123 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 12/30] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:20 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1221 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:21.336041 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2094585173", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bff8e5f5-97ad-489f-85ec-9f479ea549b7"}]}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:20:21.565666 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6260b708-4c80-49c9-8ed7-899e2f68e57d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:21.567977 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6260b708-4c80-49c9-8ed7-899e2f68e57d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:21.569705 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.network.neutron [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] validate_networks() for [('bff8e5f5-97ad-489f-85ec-9f479ea549b7', None, None, None, None, None)] {{(pid=116182) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:20:21.580528 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6260b708-4c80-49c9-8ed7-899e2f68e57d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:21.580528 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6260b708-4c80-49c9-8ed7-899e2f68e57d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:21.581033 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6260b708-4c80-49c9-8ed7-899e2f68e57d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:21.581479 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6260b708-4c80-49c9-8ed7-899e2f68e57d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:21.905261 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6260b708-4c80-49c9-8ed7-899e2f68e57d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:21.942290 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6260b708-4c80-49c9-8ed7-899e2f68e57d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1267 microversion: 2.1 time: 0.389634 Jan 17 21:20:21.944506 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 13/31] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:21 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1267 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:21.959741 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9d6872f6-47e4-4d98-9f14-a644c6993050 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8976cc28b0>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:22.017706 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-9d6872f6-47e4-4d98-9f14-a644c6993050 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b" status: 200 len: 286 microversion: 2.1 time: 0.069671 Jan 17 21:20:22.018660 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 14/32] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jan 17 21:20:21 2022] GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:22.030006 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a689ba50-44e9-4c7f-8fd2-513b7db84893 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8976cc5b80>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:22.130865 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a689ba50-44e9-4c7f-8fd2-513b7db84893 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b" status: 202 len: 0 microversion: 2.1 time: 0.104772 Jan 17 21:20:22.132947 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 15/33] 10.222.0.64 () {58 vars in 1253 bytes} [Mon Jan 17 21:20:22 2022] DELETE /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:20:22.140066 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-bb6f6e8c-0d8b-41c8-939f-98f3a76ec844 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] Calling method '.version_select at 0x7f8976c66670>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:22.250039 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-bb6f6e8c-0d8b-41c8-939f-98f3a76ec844 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d" status: 200 len: 353 microversion: 2.1 time: 0.115215 Jan 17 21:20:22.250750 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 16/34] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:22 2022] GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:22.255763 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-333a1fae-2e43-4a93-ae88-80e74fff8679 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8976c66700>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:22.330543 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-333a1fae-2e43-4a93-ae88-80e74fff8679 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b" status: 200 len: 285 microversion: 2.1 time: 0.078339 Jan 17 21:20:22.332010 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 17/35] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jan 17 21:20:22 2022] GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b => generated 285 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:22.675257 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-bc86e3be-e568-4239-9db8-1eb300b995c6 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] Calling method '.version_select at 0x7f8976cb8280>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:22.768961 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-bc86e3be-e568-4239-9db8-1eb300b995c6 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/009d652b-ad27-4b83-828a-0d992a7494dd" status: 200 len: 350 microversion: 2.1 time: 0.093895 Jan 17 21:20:22.769743 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 18/36] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:22 2022] GET /compute/v2.1/os-volumes/009d652b-ad27-4b83-828a-0d992a7494dd => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:22.782221 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-feed2d3c-207f-4749-bdc1-45c5ab05ea6e tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] Calling method '.version_select at 0x7f8976cc5ee0>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:23.016330 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-feed2d3c-207f-4749-bdc1-45c5ab05ea6e tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.236759 Jan 17 21:20:23.018563 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 19/37] 10.222.0.64 () {58 vars in 1133 bytes} [Mon Jan 17 21:20:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:20:23.032577 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5a58e19c-f8a2-4d37-b44a-291dc04d572e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:23.034712 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5a58e19c-f8a2-4d37-b44a-291dc04d572e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:23.058386 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5a58e19c-f8a2-4d37-b44a-291dc04d572e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:23.058864 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5a58e19c-f8a2-4d37-b44a-291dc04d572e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:23.061968 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5a58e19c-f8a2-4d37-b44a-291dc04d572e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:23.063614 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5a58e19c-f8a2-4d37-b44a-291dc04d572e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:23.283875 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5a58e19c-f8a2-4d37-b44a-291dc04d572e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:23.294208 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5a58e19c-f8a2-4d37-b44a-291dc04d572e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1273 microversion: 2.1 time: 0.274278 Jan 17 21:20:23.295443 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 20/38] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:23 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1273 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:23.308803 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3c761e42-d7d8-4b36-a3ed-af87886a7cd3 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] Calling method '.version_select at 0x7f8977532ca0>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:23.449555 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Flavor limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:20:23.450419 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Image limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:20:23.450673 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Flavor pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:20:23.451269 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Image pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:20:23.452972 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:20:23.486597 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:23.487170 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:23.487983 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:23.488440 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:23.544868 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3c761e42-d7d8-4b36-a3ed-af87886a7cd3 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.247756 Jan 17 21:20:23.545981 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 21/39] 10.222.0.64 () {58 vars in 1148 bytes} [Mon Jan 17 21:20:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:23.563389 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c047a365-7883-4672-abce-5a5b7ef4f406 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] Calling method '.version_select at 0x7f8976c713a0>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:23.574335 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Getting quotas for project 090730c5b4bb4a7195d893aa312dcfe6. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:20:23.605290 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Getting quotas for user 62d1680b47584ecba63c0ff2ee7667c5 and project 090730c5b4bb4a7195d893aa312dcfe6. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:20:23.671933 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Going to run 1 instances... {{(pid=116182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:20:23.675268 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:20:23.687480 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-c047a365-7883-4672-abce-5a5b7ef4f406 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] HTTP exception thrown: Volume f5ea378c-52b3-4d4e-9356-63e68c174d9d could not be found. Jan 17 21:20:23.695277 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c047a365-7883-4672-abce-5a5b7ef4f406 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] Returning 404 to user: Volume f5ea378c-52b3-4d4e-9356-63e68c174d9d could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:20:23.700226 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c047a365-7883-4672-abce-5a5b7ef4f406 tempest-VolumesGetTestJSON-1420769957 tempest-VolumesGetTestJSON-1420769957-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d" status: 404 len: 109 microversion: 2.1 time: 0.152244 Jan 17 21:20:23.701230 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 22/40] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:23 2022] GET /compute/v2.1/os-volumes/f5ea378c-52b3-4d4e-9356-63e68c174d9d => generated 109 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:20:23.715693 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-752818ea-c3ab-4ae6-90f9-abc3af76a6bb tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8976c66ca0>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:23.785222 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-752818ea-c3ab-4ae6-90f9-abc3af76a6bb tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] HTTP exception thrown: Snapshot 53204154-50fa-496a-8dd8-66b16f5dc69b could not be found. Jan 17 21:20:23.786012 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-752818ea-c3ab-4ae6-90f9-abc3af76a6bb tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Returning 404 to user: Snapshot 53204154-50fa-496a-8dd8-66b16f5dc69b could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:20:23.787139 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-752818ea-c3ab-4ae6-90f9-abc3af76a6bb tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b" status: 404 len: 111 microversion: 2.1 time: 0.084814 Jan 17 21:20:23.787971 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 23/41] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jan 17 21:20:23 2022] GET /compute/v2.1/os-snapshots/53204154-50fa-496a-8dd8-66b16f5dc69b => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:20:23.794218 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f330d634-36b9-4e1b-9400-b98ec1cd876d tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] Calling method '.version_select at 0x7f8976c573a0>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:23.832473 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8cc059c0-560e-4b38-9bbc-b5b808aabdcd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.505590 Jan 17 21:20:23.843558 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 19/42] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:20:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:20:23.858067 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-136097a8-faeb-4698-a1bd-733c0259088b tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8977458c10>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:23.948116 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f330d634-36b9-4e1b-9400-b98ec1cd876d tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.158792 Jan 17 21:20:23.948769 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 24/43] 10.222.0.64 () {58 vars in 1133 bytes} [Mon Jan 17 21:20:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:23.954371 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6f3795c9-fb1b-454c-96bd-30f804d7122a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:23.955211 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6f3795c9-fb1b-454c-96bd-30f804d7122a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:24.140058 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6f3795c9-fb1b-454c-96bd-30f804d7122a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:24.155406 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6f3795c9-fb1b-454c-96bd-30f804d7122a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1222 microversion: 2.1 time: 0.205240 Jan 17 21:20:24.160973 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-136097a8-faeb-4698-a1bd-733c0259088b tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe" status: 202 len: 0 microversion: 2.1 time: 0.315668 Jan 17 21:20:24.162006 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 20/44] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jan 17 21:20:23 2022] DELETE /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:20:24.176700 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-208b3a94-2a07-442f-931c-8eadd15bfcb1 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] Calling method '.version_select at 0x7f8977470670>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:24.183622 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 25/45] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:23 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1222 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:24.198415 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-09c35e2f-25ec-4cbb-864c-79b4d0cf987d tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8976c0ab80>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:24.422626 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-208b3a94-2a07-442f-931c-8eadd15bfcb1 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.259769 Jan 17 21:20:24.423596 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 21/46] 10.222.0.64 () {58 vars in 1166 bytes} [Mon Jan 17 21:20:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:24.427965 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-60bbaeaa-8a56-44b6-8a0a-a91790024179 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:24.429447 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-60bbaeaa-8a56-44b6-8a0a-a91790024179 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:24.442949 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60bbaeaa-8a56-44b6-8a0a-a91790024179 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:24.443411 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60bbaeaa-8a56-44b6-8a0a-a91790024179 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:24.460845 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60bbaeaa-8a56-44b6-8a0a-a91790024179 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:24.461518 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60bbaeaa-8a56-44b6-8a0a-a91790024179 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:24.573918 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-09c35e2f-25ec-4cbb-864c-79b4d0cf987d tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe" status: 200 len: 345 microversion: 2.1 time: 0.388263 Jan 17 21:20:24.574760 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 26/47] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:24 2022] GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe => generated 345 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:24.579663 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f70eb614-2237-4f4c-bb51-d7b118c177f3 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] Calling method '.version_select at 0x7f8976c15160>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:24.986345 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f70eb614-2237-4f4c-bb51-d7b118c177f3 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.409347 Jan 17 21:20:24.987038 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 27/48] 10.222.0.64 () {58 vars in 1169 bytes} [Mon Jan 17 21:20:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:25.000057 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4664b8c7-f703-4c74-9035-d76e4cff9d32 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] Calling method '.version_select at 0x7f8976c15c10>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:25.117931 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-60bbaeaa-8a56-44b6-8a0a-a91790024179 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:25.128192 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-60bbaeaa-8a56-44b6-8a0a-a91790024179 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.703524 Jan 17 21:20:25.132838 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 22/49] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:24 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:25.174732 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-309953f1-e844-4cbb-b8fa-f86ad0a2d57b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:25.176496 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-309953f1-e844-4cbb-b8fa-f86ad0a2d57b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:25.185279 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-309953f1-e844-4cbb-b8fa-f86ad0a2d57b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:25.185983 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-309953f1-e844-4cbb-b8fa-f86ad0a2d57b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:25.187956 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-309953f1-e844-4cbb-b8fa-f86ad0a2d57b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:25.188472 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-309953f1-e844-4cbb-b8fa-f86ad0a2d57b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:25.231420 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4664b8c7-f703-4c74-9035-d76e4cff9d32 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.235638 Jan 17 21:20:25.232688 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 28/50] 10.222.0.64 () {58 vars in 1154 bytes} [Mon Jan 17 21:20:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:25.246665 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-10eb14b4-a802-435c-b2fc-7bb13c3a1618 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] Calling method '.version_select at 0x7f8976c0aa60>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:25.336617 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-309953f1-e844-4cbb-b8fa-f86ad0a2d57b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:25.350901 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-309953f1-e844-4cbb-b8fa-f86ad0a2d57b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1226 microversion: 2.1 time: 0.179663 Jan 17 21:20:25.351983 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 23/51] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:25 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1226 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:25.413519 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-10eb14b4-a802-435c-b2fc-7bb13c3a1618 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.169439 Jan 17 21:20:25.414849 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 29/52] 10.222.0.64 () {58 vars in 1187 bytes} [Mon Jan 17 21:20:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:25.426624 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1f79e9a5-6856-4eb3-8ec7-248e4612e694 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] Calling method '.version_select at 0x7f8976c07160>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:25.556621 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1f79e9a5-6856-4eb3-8ec7-248e4612e694 tempest-VolumesTestJSON-1941766169 tempest-VolumesTestJSON-1941766169-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.132039 Jan 17 21:20:25.557503 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 24/53] 10.222.0.64 () {58 vars in 1154 bytes} [Mon Jan 17 21:20:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:25.587603 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-66f70052-b42b-448d-a91e-7342c968ca21 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8976c66040>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:25.690417 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-66f70052-b42b-448d-a91e-7342c968ca21 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe" status: 200 len: 345 microversion: 2.1 time: 0.107080 Jan 17 21:20:25.691683 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 30/54] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:25 2022] GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe => generated 345 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:26.147977 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8e908006-ce38-4cf9-b486-3c3c47da9016 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:26.148750 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8e908006-ce38-4cf9-b486-3c3c47da9016 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:26.155381 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8e908006-ce38-4cf9-b486-3c3c47da9016 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:26.155941 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8e908006-ce38-4cf9-b486-3c3c47da9016 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:26.157850 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8e908006-ce38-4cf9-b486-3c3c47da9016 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:26.157850 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8e908006-ce38-4cf9-b486-3c3c47da9016 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:26.338246 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-8e908006-ce38-4cf9-b486-3c3c47da9016 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:26.347485 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8e908006-ce38-4cf9-b486-3c3c47da9016 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.202965 Jan 17 21:20:26.348416 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 25/55] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:26 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:26.368763 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e8197a39-dec7-4758-a5f0-e3dc92f26257 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:26.369674 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e8197a39-dec7-4758-a5f0-e3dc92f26257 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:26.378115 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e8197a39-dec7-4758-a5f0-e3dc92f26257 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:26.378579 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e8197a39-dec7-4758-a5f0-e3dc92f26257 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:26.379379 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e8197a39-dec7-4758-a5f0-e3dc92f26257 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:26.379817 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e8197a39-dec7-4758-a5f0-e3dc92f26257 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:26.466585 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-e8197a39-dec7-4758-a5f0-e3dc92f26257 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:26.474002 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e8197a39-dec7-4758-a5f0-e3dc92f26257 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1226 microversion: 2.1 time: 0.109686 Jan 17 21:20:26.476464 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 26/56] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:26 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:26.497794 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e2135ba8-c08b-4a9f-a474-57f0c44ada3a tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] Action: 'create', calling method: .version_select at 0x7f8976cb83a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1368096184", "metadata": {"Type": "work"}}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:20:26.499146 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e2135ba8-c08b-4a9f-a474-57f0c44ada3a tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:20:26.499936 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e2135ba8-c08b-4a9f-a474-57f0c44ada3a tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.202367 Jan 17 21:20:26.500480 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 31/57] 10.222.0.64 () {60 vars in 1155 bytes} [Mon Jan 17 21:20:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 203 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 17 21:20:26.510638 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5294faab-f8dd-4a4a-a303-c05895ec8093 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] Action: 'create', calling method: .version_select at 0x7f8977478310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-775695396", "metadata": {"Type": "work"}}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:20:26.512036 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5294faab-f8dd-4a4a-a303-c05895ec8093 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:20:26.512897 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5294faab-f8dd-4a4a-a303-c05895ec8093 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006622 Jan 17 21:20:26.513352 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 27/58] 10.222.0.64 () {60 vars in 1155 bytes} [Mon Jan 17 21:20:26 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 17 21:20:26.522754 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f14ece58-8350-4260-b66a-375be7fb0da5 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] Action: 'create', calling method: .version_select at 0x7f8976c0a310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-589106722", "metadata": {"Type": "work"}}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:20:26.523933 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f14ece58-8350-4260-b66a-375be7fb0da5 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:20:26.524822 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f14ece58-8350-4260-b66a-375be7fb0da5 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006330 Jan 17 21:20:26.525353 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 32/59] 10.222.0.64 () {60 vars in 1155 bytes} [Mon Jan 17 21:20:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 17 21:20:26.534461 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8e6befc1-a85d-46bc-b3aa-4a202d5be978 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] Calling method '.version_select at 0x7f8976c07430>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:26.563834 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-8e6befc1-a85d-46bc-b3aa-4a202d5be978 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] HTTP exception thrown: Volume tempest-invalid-1318335713 could not be found. Jan 17 21:20:26.566083 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8e6befc1-a85d-46bc-b3aa-4a202d5be978 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] Returning 404 to user: Volume tempest-invalid-1318335713 could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:20:26.567206 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8e6befc1-a85d-46bc-b3aa-4a202d5be978 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1318335713" status: 404 len: 99 microversion: 2.1 time: 0.036148 Jan 17 21:20:26.567763 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 28/60] 10.222.0.64 () {58 vars in 1217 bytes} [Mon Jan 17 21:20:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1318335713 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 17 21:20:26.577436 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-619e9b51-21ba-4d4f-88e5-0d06a6827d6f tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003985 Jan 17 21:20:26.577944 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 33/61] 10.222.0.64 () {58 vars in 1139 bytes} [Mon Jan 17 21:20:26 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 17 21:20:26.586446 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-75f9240c-f155-4271-abe4-a9e57dbd1fc1 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003695 Jan 17 21:20:26.586991 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 29/62] 10.222.0.64 () {58 vars in 1136 bytes} [Mon Jan 17 21:20:26 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 17 21:20:26.595818 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1827f50c-8cc9-4a22-b029-ea59278c4e36 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] Calling method '.version_select at 0x7f8976c0a310>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:26.622346 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-1827f50c-8cc9-4a22-b029-ea59278c4e36 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] HTTP exception thrown: Volume 568d743c-a9ff-472f-a493-9f113cca5f09 could not be found. Jan 17 21:20:26.622949 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1827f50c-8cc9-4a22-b029-ea59278c4e36 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] Returning 404 to user: Volume 568d743c-a9ff-472f-a493-9f113cca5f09 could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:20:26.623788 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1827f50c-8cc9-4a22-b029-ea59278c4e36 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/568d743c-a9ff-472f-a493-9f113cca5f09" status: 404 len: 109 microversion: 2.1 time: 0.031593 Jan 17 21:20:26.624486 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 34/63] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jan 17 21:20:26 2022] DELETE /compute/v2.1/os-volumes/568d743c-a9ff-472f-a493-9f113cca5f09 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 17 21:20:26.633212 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7d6f7420-de35-4c49-aafa-c7032e0dfef6 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] Calling method '.version_select at 0x7f89774780d0>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:26.659518 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-7d6f7420-de35-4c49-aafa-c7032e0dfef6 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] HTTP exception thrown: Volume 326ee794-255e-41e5-8117-bccbbe48ef0f could not be found. Jan 17 21:20:26.660102 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7d6f7420-de35-4c49-aafa-c7032e0dfef6 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] Returning 404 to user: Volume 326ee794-255e-41e5-8117-bccbbe48ef0f could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:20:26.660965 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7d6f7420-de35-4c49-aafa-c7032e0dfef6 tempest-VolumesNegativeTest-1274886625 tempest-VolumesNegativeTest-1274886625-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/326ee794-255e-41e5-8117-bccbbe48ef0f" status: 404 len: 109 microversion: 2.1 time: 0.031610 Jan 17 21:20:26.661505 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 30/64] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:26 2022] GET /compute/v2.1/os-volumes/326ee794-255e-41e5-8117-bccbbe48ef0f => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 17 21:20:26.705266 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-37501ba7-b377-4922-851d-41c98cb15a3b tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8976cc2b80>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:26.756061 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-37501ba7-b377-4922-851d-41c98cb15a3b tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe" status: 200 len: 345 microversion: 2.1 time: 0.054709 Jan 17 21:20:26.756840 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 35/65] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:26 2022] GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:27.365465 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ca7e6e50-5100-480c-adc2-64e65bc0355d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:27.366774 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ca7e6e50-5100-480c-adc2-64e65bc0355d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:27.376432 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca7e6e50-5100-480c-adc2-64e65bc0355d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:27.377134 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca7e6e50-5100-480c-adc2-64e65bc0355d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:27.379177 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca7e6e50-5100-480c-adc2-64e65bc0355d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:27.380348 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca7e6e50-5100-480c-adc2-64e65bc0355d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:27.491650 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7c57d7e9-5823-4e22-8cdd-a4ac8c08ef55 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:27.492727 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7c57d7e9-5823-4e22-8cdd-a4ac8c08ef55 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:27.501264 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7c57d7e9-5823-4e22-8cdd-a4ac8c08ef55 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:27.502234 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7c57d7e9-5823-4e22-8cdd-a4ac8c08ef55 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:27.503565 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7c57d7e9-5823-4e22-8cdd-a4ac8c08ef55 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:27.504493 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7c57d7e9-5823-4e22-8cdd-a4ac8c08ef55 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:27.634380 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7c57d7e9-5823-4e22-8cdd-a4ac8c08ef55 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:27.645229 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7c57d7e9-5823-4e22-8cdd-a4ac8c08ef55 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1226 microversion: 2.1 time: 0.157843 Jan 17 21:20:27.668883 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 36/66] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:27 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1226 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:20:27.706482 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ca7e6e50-5100-480c-adc2-64e65bc0355d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:27.715446 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ca7e6e50-5100-480c-adc2-64e65bc0355d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.355505 Jan 17 21:20:27.716167 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 31/67] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:27 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:27.769440 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-47d5ddbc-d9a3-4305-bd29-8ca4811e58c0 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8976c0a820>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:27.859968 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-47d5ddbc-d9a3-4305-bd29-8ca4811e58c0 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe" status: 200 len: 345 microversion: 2.1 time: 0.094399 Jan 17 21:20:27.860855 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 37/68] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:27 2022] GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe => generated 345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:28.663027 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a526d7c7-412d-4c27-8d7a-0312fa2f2cb3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:28.663940 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a526d7c7-412d-4c27-8d7a-0312fa2f2cb3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:28.678442 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a526d7c7-412d-4c27-8d7a-0312fa2f2cb3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:28.681109 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a526d7c7-412d-4c27-8d7a-0312fa2f2cb3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:28.685324 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a526d7c7-412d-4c27-8d7a-0312fa2f2cb3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:28.685790 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a526d7c7-412d-4c27-8d7a-0312fa2f2cb3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:28.735763 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d92f4f22-b097-42f0-bbcb-eb44bc02509f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:28.737614 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d92f4f22-b097-42f0-bbcb-eb44bc02509f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:28.768320 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d92f4f22-b097-42f0-bbcb-eb44bc02509f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:28.770554 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d92f4f22-b097-42f0-bbcb-eb44bc02509f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:28.773681 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d92f4f22-b097-42f0-bbcb-eb44bc02509f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:28.777674 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d92f4f22-b097-42f0-bbcb-eb44bc02509f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:28.838387 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a526d7c7-412d-4c27-8d7a-0312fa2f2cb3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:28.846951 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a526d7c7-412d-4c27-8d7a-0312fa2f2cb3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1226 microversion: 2.1 time: 0.187628 Jan 17 21:20:28.848641 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 32/69] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:28 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1226 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:28.881001 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d022fb9f-42b5-46a7-aef1-a324de5addfb tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f89774781f0>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:28.988415 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-d022fb9f-42b5-46a7-aef1-a324de5addfb tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] HTTP exception thrown: Volume ca1255f2-fbf2-4f54-a605-3c750bd47bbe could not be found. Jan 17 21:20:28.989199 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d022fb9f-42b5-46a7-aef1-a324de5addfb tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Returning 404 to user: Volume ca1255f2-fbf2-4f54-a605-3c750bd47bbe could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:20:28.990371 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d022fb9f-42b5-46a7-aef1-a324de5addfb tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe" status: 404 len: 109 microversion: 2.1 time: 0.113028 Jan 17 21:20:28.991128 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 33/70] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:28 2022] GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:20:29.008791 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e4b1b28e-2ccc-4ed4-934b-4eacdb6d25e3 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8978656e50>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:29.058171 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-e4b1b28e-2ccc-4ed4-934b-4eacdb6d25e3 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] HTTP exception thrown: Volume ca1255f2-fbf2-4f54-a605-3c750bd47bbe could not be found. Jan 17 21:20:29.059081 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e4b1b28e-2ccc-4ed4-934b-4eacdb6d25e3 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Returning 404 to user: Volume ca1255f2-fbf2-4f54-a605-3c750bd47bbe could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:20:29.060068 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e4b1b28e-2ccc-4ed4-934b-4eacdb6d25e3 tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe" status: 404 len: 109 microversion: 2.1 time: 0.054960 Jan 17 21:20:29.064051 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 34/71] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jan 17 21:20:29 2022] DELETE /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:20:29.072435 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0218d045-54ac-48f9-8723-53b78046005b tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Calling method '.version_select at 0x7f8977478670>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:29.135299 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-0218d045-54ac-48f9-8723-53b78046005b tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] HTTP exception thrown: Volume ca1255f2-fbf2-4f54-a605-3c750bd47bbe could not be found. Jan 17 21:20:29.136170 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0218d045-54ac-48f9-8723-53b78046005b tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] Returning 404 to user: Volume ca1255f2-fbf2-4f54-a605-3c750bd47bbe could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:20:29.137274 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0218d045-54ac-48f9-8723-53b78046005b tempest-VolumesSnapshotsTestJSON-1308364345 tempest-VolumesSnapshotsTestJSON-1308364345-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe" status: 404 len: 109 microversion: 2.1 time: 0.070754 Jan 17 21:20:29.138421 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 35/72] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jan 17 21:20:29 2022] GET /compute/v2.1/os-volumes/ca1255f2-fbf2-4f54-a605-3c750bd47bbe => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:20:29.186644 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-d92f4f22-b097-42f0-bbcb-eb44bc02509f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:29.199709 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d92f4f22-b097-42f0-bbcb-eb44bc02509f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.467295 Jan 17 21:20:29.201312 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 38/73] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:28 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:29.876894 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c6ba6036-fbfb-4a6d-82e1-a110bda5c895 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:29.880973 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c6ba6036-fbfb-4a6d-82e1-a110bda5c895 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:29.899697 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c6ba6036-fbfb-4a6d-82e1-a110bda5c895 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:29.900822 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c6ba6036-fbfb-4a6d-82e1-a110bda5c895 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:29.921712 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c6ba6036-fbfb-4a6d-82e1-a110bda5c895 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:29.923231 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c6ba6036-fbfb-4a6d-82e1-a110bda5c895 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:30.062363 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c6ba6036-fbfb-4a6d-82e1-a110bda5c895 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:30.075107 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c6ba6036-fbfb-4a6d-82e1-a110bda5c895 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1218 microversion: 2.1 time: 0.213413 Jan 17 21:20:30.075835 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 36/74] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:29 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:30.217877 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2c712b1a-2cab-4ec7-bda1-762ecb7725bb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:30.219804 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2c712b1a-2cab-4ec7-bda1-762ecb7725bb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:30.231974 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c712b1a-2cab-4ec7-bda1-762ecb7725bb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:30.233414 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c712b1a-2cab-4ec7-bda1-762ecb7725bb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:30.237228 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c712b1a-2cab-4ec7-bda1-762ecb7725bb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:30.238378 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c712b1a-2cab-4ec7-bda1-762ecb7725bb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:30.490108 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2c712b1a-2cab-4ec7-bda1-762ecb7725bb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:30.499247 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2c712b1a-2cab-4ec7-bda1-762ecb7725bb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.285507 Jan 17 21:20:30.500296 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 39/75] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:30 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:31.095558 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-dcb30fb6-90da-4b23-8cbe-208bb134b7d5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:31.096880 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-dcb30fb6-90da-4b23-8cbe-208bb134b7d5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:31.127480 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dcb30fb6-90da-4b23-8cbe-208bb134b7d5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:31.128283 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dcb30fb6-90da-4b23-8cbe-208bb134b7d5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:31.129334 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dcb30fb6-90da-4b23-8cbe-208bb134b7d5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:31.129839 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dcb30fb6-90da-4b23-8cbe-208bb134b7d5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:31.250712 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-dcb30fb6-90da-4b23-8cbe-208bb134b7d5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:31.259694 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-dcb30fb6-90da-4b23-8cbe-208bb134b7d5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1218 microversion: 2.1 time: 0.169932 Jan 17 21:20:31.260826 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 37/76] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:31 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1218 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:31.515180 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b7c2635d-afea-48ce-be6e-8d86a7fb4512 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:31.515862 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b7c2635d-afea-48ce-be6e-8d86a7fb4512 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:31.533245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b7c2635d-afea-48ce-be6e-8d86a7fb4512 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:31.533245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b7c2635d-afea-48ce-be6e-8d86a7fb4512 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:31.533245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b7c2635d-afea-48ce-be6e-8d86a7fb4512 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:31.533245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b7c2635d-afea-48ce-be6e-8d86a7fb4512 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:31.730648 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b7c2635d-afea-48ce-be6e-8d86a7fb4512 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:31.739764 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b7c2635d-afea-48ce-be6e-8d86a7fb4512 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.227916 Jan 17 21:20:31.740696 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 40/77] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:31 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:32.278637 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-50c032c3-a72f-4691-97ba-af34ce327eb2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:32.279260 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-50c032c3-a72f-4691-97ba-af34ce327eb2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:32.285471 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-50c032c3-a72f-4691-97ba-af34ce327eb2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:32.286155 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-50c032c3-a72f-4691-97ba-af34ce327eb2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:32.287157 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-50c032c3-a72f-4691-97ba-af34ce327eb2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:32.287605 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-50c032c3-a72f-4691-97ba-af34ce327eb2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:32.369542 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-50c032c3-a72f-4691-97ba-af34ce327eb2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:32.402014 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-50c032c3-a72f-4691-97ba-af34ce327eb2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1218 microversion: 2.1 time: 0.127862 Jan 17 21:20:32.405527 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 38/78] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:32 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:32.756749 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2119b903-8493-45d9-a3b4-eacd9313f0ab tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:32.757316 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2119b903-8493-45d9-a3b4-eacd9313f0ab tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:32.763693 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2119b903-8493-45d9-a3b4-eacd9313f0ab tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:32.764153 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2119b903-8493-45d9-a3b4-eacd9313f0ab tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:32.764978 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2119b903-8493-45d9-a3b4-eacd9313f0ab tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:32.765421 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2119b903-8493-45d9-a3b4-eacd9313f0ab tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:32.890327 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2119b903-8493-45d9-a3b4-eacd9313f0ab tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:32.897690 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2119b903-8493-45d9-a3b4-eacd9313f0ab tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.144622 Jan 17 21:20:32.898255 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 41/79] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:32 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:33.423438 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0c7a03a5-7212-41f7-8848-7239f184ced1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:33.423438 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0c7a03a5-7212-41f7-8848-7239f184ced1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:33.429961 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0c7a03a5-7212-41f7-8848-7239f184ced1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:33.431512 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0c7a03a5-7212-41f7-8848-7239f184ced1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:33.432332 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0c7a03a5-7212-41f7-8848-7239f184ced1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:33.433003 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0c7a03a5-7212-41f7-8848-7239f184ced1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:33.507342 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-0c7a03a5-7212-41f7-8848-7239f184ced1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:33.518134 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0c7a03a5-7212-41f7-8848-7239f184ced1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1218 microversion: 2.1 time: 0.100019 Jan 17 21:20:33.529897 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 39/80] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:33 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:20:33.915793 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-042ab7c7-8587-4284-a369-b884c02d0b9e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:33.916645 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-042ab7c7-8587-4284-a369-b884c02d0b9e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:33.922943 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-042ab7c7-8587-4284-a369-b884c02d0b9e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:33.923405 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-042ab7c7-8587-4284-a369-b884c02d0b9e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:33.924238 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-042ab7c7-8587-4284-a369-b884c02d0b9e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:33.924712 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-042ab7c7-8587-4284-a369-b884c02d0b9e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:34.191549 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-042ab7c7-8587-4284-a369-b884c02d0b9e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:34.198926 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-042ab7c7-8587-4284-a369-b884c02d0b9e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.287470 Jan 17 21:20:34.199482 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 42/81] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:33 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:34.535403 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-96f4a96d-6334-422d-a761-3970a1ef5c5d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:34.536008 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-96f4a96d-6334-422d-a761-3970a1ef5c5d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:34.542559 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-96f4a96d-6334-422d-a761-3970a1ef5c5d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:34.543004 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-96f4a96d-6334-422d-a761-3970a1ef5c5d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:34.543779 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-96f4a96d-6334-422d-a761-3970a1ef5c5d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:34.544218 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-96f4a96d-6334-422d-a761-3970a1ef5c5d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:34.601004 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-96f4a96d-6334-422d-a761-3970a1ef5c5d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:34.608967 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-96f4a96d-6334-422d-a761-3970a1ef5c5d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1218 microversion: 2.1 time: 0.076944 Jan 17 21:20:34.609532 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 40/82] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:34 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:35.215533 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0581337b-a530-4cc4-853a-ae1690472720 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:35.216243 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-0581337b-a530-4cc4-853a-ae1690472720 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:35.222566 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0581337b-a530-4cc4-853a-ae1690472720 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:35.223029 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0581337b-a530-4cc4-853a-ae1690472720 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:35.223835 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0581337b-a530-4cc4-853a-ae1690472720 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:35.224284 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0581337b-a530-4cc4-853a-ae1690472720 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:35.376253 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-0581337b-a530-4cc4-853a-ae1690472720 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:35.384467 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-0581337b-a530-4cc4-853a-ae1690472720 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.172930 Jan 17 21:20:35.385043 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 43/83] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:35 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:35.627142 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e9c7ac2f-21ac-4f36-83e6-ea9ee1f484f7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:35.627697 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e9c7ac2f-21ac-4f36-83e6-ea9ee1f484f7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:35.634843 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e9c7ac2f-21ac-4f36-83e6-ea9ee1f484f7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:35.635307 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e9c7ac2f-21ac-4f36-83e6-ea9ee1f484f7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:35.636282 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e9c7ac2f-21ac-4f36-83e6-ea9ee1f484f7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:35.636952 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e9c7ac2f-21ac-4f36-83e6-ea9ee1f484f7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:35.718025 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-e9c7ac2f-21ac-4f36-83e6-ea9ee1f484f7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:35.734692 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e9c7ac2f-21ac-4f36-83e6-ea9ee1f484f7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1218 microversion: 2.1 time: 0.111506 Jan 17 21:20:35.735274 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 41/84] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:35 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:36.401826 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8aa714d1-88a2-4ce0-916a-504c4f5228b2 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:36.402461 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8aa714d1-88a2-4ce0-916a-504c4f5228b2 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:36.411245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8aa714d1-88a2-4ce0-916a-504c4f5228b2 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:36.411790 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8aa714d1-88a2-4ce0-916a-504c4f5228b2 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:36.412734 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8aa714d1-88a2-4ce0-916a-504c4f5228b2 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:36.413258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8aa714d1-88a2-4ce0-916a-504c4f5228b2 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:36.629489 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8aa714d1-88a2-4ce0-916a-504c4f5228b2 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:36.639847 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8aa714d1-88a2-4ce0-916a-504c4f5228b2 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.242693 Jan 17 21:20:36.640961 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 44/85] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:36 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:36.755723 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3ff3ab38-a2c4-4ca1-801b-c1c62fe5c05a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:36.756982 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-3ff3ab38-a2c4-4ca1-801b-c1c62fe5c05a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:36.768039 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ff3ab38-a2c4-4ca1-801b-c1c62fe5c05a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:36.768846 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ff3ab38-a2c4-4ca1-801b-c1c62fe5c05a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:36.770064 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ff3ab38-a2c4-4ca1-801b-c1c62fe5c05a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:36.771016 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ff3ab38-a2c4-4ca1-801b-c1c62fe5c05a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:36.995170 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-3ff3ab38-a2c4-4ca1-801b-c1c62fe5c05a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:37.004989 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3ff3ab38-a2c4-4ca1-801b-c1c62fe5c05a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1218 microversion: 2.1 time: 0.253234 Jan 17 21:20:37.018108 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 42/86] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:36 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1218 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:37.657815 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5c2cf9e5-2b73-419b-896a-6d37100b27eb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:37.659184 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5c2cf9e5-2b73-419b-896a-6d37100b27eb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:37.671460 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5c2cf9e5-2b73-419b-896a-6d37100b27eb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:37.672481 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5c2cf9e5-2b73-419b-896a-6d37100b27eb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:37.673609 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5c2cf9e5-2b73-419b-896a-6d37100b27eb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:37.674896 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5c2cf9e5-2b73-419b-896a-6d37100b27eb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:38.024807 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-30666ec7-8928-4e49-beaa-836bd8dbe7ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:38.026208 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-30666ec7-8928-4e49-beaa-836bd8dbe7ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:38.049696 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-30666ec7-8928-4e49-beaa-836bd8dbe7ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:38.054323 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-30666ec7-8928-4e49-beaa-836bd8dbe7ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:38.062433 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-30666ec7-8928-4e49-beaa-836bd8dbe7ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:38.069473 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-30666ec7-8928-4e49-beaa-836bd8dbe7ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:38.192080 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5c2cf9e5-2b73-419b-896a-6d37100b27eb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:38.203351 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5c2cf9e5-2b73-419b-896a-6d37100b27eb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.548857 Jan 17 21:20:38.203935 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 45/87] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:37 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:20:38.278806 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-30666ec7-8928-4e49-beaa-836bd8dbe7ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:38.288548 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-30666ec7-8928-4e49-beaa-836bd8dbe7ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1218 microversion: 2.1 time: 0.268617 Jan 17 21:20:38.290550 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 43/88] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:38 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1218 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:39.223774 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-719a826c-5505-4ca5-ac54-beb08fe148e1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:39.230241 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-719a826c-5505-4ca5-ac54-beb08fe148e1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:39.252796 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-719a826c-5505-4ca5-ac54-beb08fe148e1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:39.270213 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-719a826c-5505-4ca5-ac54-beb08fe148e1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:39.276275 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-719a826c-5505-4ca5-ac54-beb08fe148e1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:39.279658 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-719a826c-5505-4ca5-ac54-beb08fe148e1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:39.307367 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e0f11b01-1dc3-4cd9-a575-c0ef84692a77 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:39.308647 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e0f11b01-1dc3-4cd9-a575-c0ef84692a77 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:39.324920 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e0f11b01-1dc3-4cd9-a575-c0ef84692a77 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:39.326150 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e0f11b01-1dc3-4cd9-a575-c0ef84692a77 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:39.328097 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e0f11b01-1dc3-4cd9-a575-c0ef84692a77 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:39.329690 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e0f11b01-1dc3-4cd9-a575-c0ef84692a77 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:39.722822 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-e0f11b01-1dc3-4cd9-a575-c0ef84692a77 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:39.734124 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e0f11b01-1dc3-4cd9-a575-c0ef84692a77 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1280 microversion: 2.1 time: 0.430332 Jan 17 21:20:39.745776 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 44/89] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:39 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1280 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:40.198002 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-719a826c-5505-4ca5-ac54-beb08fe148e1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:40.206919 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-719a826c-5505-4ca5-ac54-beb08fe148e1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.986711 Jan 17 21:20:40.217740 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 46/90] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:39 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:40.753445 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-88a22e51-8fef-4858-a31a-001d28bb5af7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:40.755056 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-88a22e51-8fef-4858-a31a-001d28bb5af7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:40.765649 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-88a22e51-8fef-4858-a31a-001d28bb5af7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:40.766440 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-88a22e51-8fef-4858-a31a-001d28bb5af7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:40.770407 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-88a22e51-8fef-4858-a31a-001d28bb5af7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:40.771121 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-88a22e51-8fef-4858-a31a-001d28bb5af7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:40.914078 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-87b064ca-bcb4-46f2-ada1-033f2bcc04a3 req-04637450-1ed5-4787-881d-7d89e5f5ee73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "069fd10f-3002-4910-884d-0bfc2697b631", "tag": "6bbdf179-7baf-44c9-8cb0-3aa9f2f9d689"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:20:40.921545 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:20:40.921545 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:20:40.946894 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-88a22e51-8fef-4858-a31a-001d28bb5af7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:40.962437 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-88a22e51-8fef-4858-a31a-001d28bb5af7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1280 microversion: 2.1 time: 0.212686 Jan 17 21:20:40.963807 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 47/91] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:40 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:20:40.966358 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-87b064ca-bcb4-46f2-ada1-033f2bcc04a3 req-04637450-1ed5-4787-881d-7d89e5f5ee73 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:40.977720 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-87b064ca-bcb4-46f2-ada1-033f2bcc04a3 req-04637450-1ed5-4787-881d-7d89e5f5ee73 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:41.041052 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-87b064ca-bcb4-46f2-ada1-033f2bcc04a3 req-04637450-1ed5-4787-881d-7d89e5f5ee73 service nova] Creating event network-changed:6bbdf179-7baf-44c9-8cb0-3aa9f2f9d689 for instance 069fd10f-3002-4910-884d-0bfc2697b631 on hv-cinder-82489 Jan 17 21:20:41.041610 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-87b064ca-bcb4-46f2-ada1-033f2bcc04a3 req-04637450-1ed5-4787-881d-7d89e5f5ee73 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116182) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 17 21:20:41.042797 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-74b7588e-bb6d-4584-a7d1-9e6e361638bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:41.043249 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-74b7588e-bb6d-4584-a7d1-9e6e361638bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:41.044065 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-74b7588e-bb6d-4584-a7d1-9e6e361638bc None None] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:41.044538 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-74b7588e-bb6d-4584-a7d1-9e6e361638bc None None] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:41.068728 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.compute.rpcapi [None req-74b7588e-bb6d-4584-a7d1-9e6e361638bc None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 17 21:20:41.069627 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-74b7588e-bb6d-4584-a7d1-9e6e361638bc None None] Releasing lock "compute-rpcapi-router" {{(pid=116182) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 17 21:20:41.098536 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-74b7588e-bb6d-4584-a7d1-9e6e361638bc None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.361749 Jan 17 21:20:41.099344 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 45/92] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:41.224175 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-84f9b835-7932-4fa6-8984-07618f3c2d00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:41.225423 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-84f9b835-7932-4fa6-8984-07618f3c2d00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:41.234382 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-84f9b835-7932-4fa6-8984-07618f3c2d00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:41.235163 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-84f9b835-7932-4fa6-8984-07618f3c2d00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:41.237505 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-84f9b835-7932-4fa6-8984-07618f3c2d00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:41.238195 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-84f9b835-7932-4fa6-8984-07618f3c2d00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:41.770595 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-84f9b835-7932-4fa6-8984-07618f3c2d00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:41.780181 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-84f9b835-7932-4fa6-8984-07618f3c2d00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.559584 Jan 17 21:20:41.785144 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 48/93] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:41 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:41.988616 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a9adc26f-f815-4302-866d-ac2e39a2963b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:41.990169 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a9adc26f-f815-4302-866d-ac2e39a2963b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:41.998842 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a9adc26f-f815-4302-866d-ac2e39a2963b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:41.999634 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a9adc26f-f815-4302-866d-ac2e39a2963b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:42.000698 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a9adc26f-f815-4302-866d-ac2e39a2963b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:42.001344 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a9adc26f-f815-4302-866d-ac2e39a2963b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:42.209247 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a9adc26f-f815-4302-866d-ac2e39a2963b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:42.223064 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a9adc26f-f815-4302-866d-ac2e39a2963b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1322 microversion: 2.1 time: 0.245552 Jan 17 21:20:42.223685 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 46/94] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:41 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:42.801237 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0c7468a0-6ca6-4ee8-8817-f2ae544554b3 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:42.801849 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-0c7468a0-6ca6-4ee8-8817-f2ae544554b3 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:42.811895 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0c7468a0-6ca6-4ee8-8817-f2ae544554b3 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:42.812360 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0c7468a0-6ca6-4ee8-8817-f2ae544554b3 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:42.813199 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0c7468a0-6ca6-4ee8-8817-f2ae544554b3 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:42.813656 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0c7468a0-6ca6-4ee8-8817-f2ae544554b3 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:43.241428 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-35be17c8-dcc2-4b34-8b96-b386fa94ad6b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:43.243185 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-35be17c8-dcc2-4b34-8b96-b386fa94ad6b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:43.260086 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-0c7468a0-6ca6-4ee8-8817-f2ae544554b3 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:43.261205 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35be17c8-dcc2-4b34-8b96-b386fa94ad6b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:43.262002 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35be17c8-dcc2-4b34-8b96-b386fa94ad6b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:43.263039 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35be17c8-dcc2-4b34-8b96-b386fa94ad6b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:43.263686 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35be17c8-dcc2-4b34-8b96-b386fa94ad6b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:43.267847 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-0c7468a0-6ca6-4ee8-8817-f2ae544554b3 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.470127 Jan 17 21:20:43.277686 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 49/95] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:42 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:43.699704 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-35be17c8-dcc2-4b34-8b96-b386fa94ad6b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:43.707029 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-35be17c8-dcc2-4b34-8b96-b386fa94ad6b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1322 microversion: 2.1 time: 0.469586 Jan 17 21:20:43.707602 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 47/96] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:43 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1322 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:20:43.747020 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-c73113f4-a9a3-487c-8a17-2cae90a0817a req-fc20795b-159a-48a7-b1a8-6bb097f92906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a5818e4-0026-4597-9ef3-d539c2cdee97", "tag": "138d0a50-2135-4dee-95fa-28ecdc541d3d"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:20:43.753161 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:20:43.753161 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:20:43.774185 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-c73113f4-a9a3-487c-8a17-2cae90a0817a req-fc20795b-159a-48a7-b1a8-6bb097f92906 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:43.775693 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-c73113f4-a9a3-487c-8a17-2cae90a0817a req-fc20795b-159a-48a7-b1a8-6bb097f92906 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:43.801539 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-c73113f4-a9a3-487c-8a17-2cae90a0817a req-fc20795b-159a-48a7-b1a8-6bb097f92906 service nova] Creating event network-changed:138d0a50-2135-4dee-95fa-28ecdc541d3d for instance 8a5818e4-0026-4597-9ef3-d539c2cdee97 on hv-cinder-82489 Jan 17 21:20:43.802501 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-c73113f4-a9a3-487c-8a17-2cae90a0817a req-fc20795b-159a-48a7-b1a8-6bb097f92906 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116183) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 17 21:20:43.804399 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-744484d9-37e8-4630-aba9-81af5729c702 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:43.806282 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-744484d9-37e8-4630-aba9-81af5729c702 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:43.807405 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-744484d9-37e8-4630-aba9-81af5729c702 None None] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:43.808014 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-744484d9-37e8-4630-aba9-81af5729c702 None None] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:43.819665 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.compute.rpcapi [None req-744484d9-37e8-4630-aba9-81af5729c702 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 17 21:20:43.821763 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-744484d9-37e8-4630-aba9-81af5729c702 None None] Releasing lock "compute-rpcapi-router" {{(pid=116183) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 17 21:20:43.861144 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-744484d9-37e8-4630-aba9-81af5729c702 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118900 Jan 17 21:20:43.863789 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 50/97] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:20:44.286214 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5e63ac95-6ae8-44f3-b3aa-08a2cc6376f1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:44.287082 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5e63ac95-6ae8-44f3-b3aa-08a2cc6376f1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:44.299624 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5e63ac95-6ae8-44f3-b3aa-08a2cc6376f1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:44.299975 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5e63ac95-6ae8-44f3-b3aa-08a2cc6376f1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:44.301268 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5e63ac95-6ae8-44f3-b3aa-08a2cc6376f1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:44.301886 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5e63ac95-6ae8-44f3-b3aa-08a2cc6376f1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:44.542533 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5e63ac95-6ae8-44f3-b3aa-08a2cc6376f1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:44.553504 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5e63ac95-6ae8-44f3-b3aa-08a2cc6376f1 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.272300 Jan 17 21:20:44.554309 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 51/98] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:44 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:20:44.578752 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-97cc2e78-c925-4ab6-bac2-acacc3874b61 req-0b17f240-22d1-4424-b2f3-08a9c5b99a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0057c90-b41a-4cd1-a9fa-01cb2da4fef6", "tag": "97a2a727-ca87-4934-94e8-4e197d2e3622"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:20:44.581098 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:20:44.581098 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:20:44.597658 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-97cc2e78-c925-4ab6-bac2-acacc3874b61 req-0b17f240-22d1-4424-b2f3-08a9c5b99a46 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:44.600089 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-97cc2e78-c925-4ab6-bac2-acacc3874b61 req-0b17f240-22d1-4424-b2f3-08a9c5b99a46 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:44.630766 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-97cc2e78-c925-4ab6-bac2-acacc3874b61 req-0b17f240-22d1-4424-b2f3-08a9c5b99a46 service nova] Creating event network-changed:97a2a727-ca87-4934-94e8-4e197d2e3622 for instance e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 on hv-cinder-82489 Jan 17 21:20:44.638340 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-97cc2e78-c925-4ab6-bac2-acacc3874b61 req-0b17f240-22d1-4424-b2f3-08a9c5b99a46 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.666350 Jan 17 21:20:44.642625 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 48/99] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:20:44.727127 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2c1dbbc4-7be6-48a5-a5a5-c27528baa7ed tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:44.727841 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2c1dbbc4-7be6-48a5-a5a5-c27528baa7ed tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:44.741879 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c1dbbc4-7be6-48a5-a5a5-c27528baa7ed tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:44.743001 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c1dbbc4-7be6-48a5-a5a5-c27528baa7ed tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:44.748399 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c1dbbc4-7be6-48a5-a5a5-c27528baa7ed tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:44.749042 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c1dbbc4-7be6-48a5-a5a5-c27528baa7ed tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:45.469119 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2c1dbbc4-7be6-48a5-a5a5-c27528baa7ed tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:45.478095 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2c1dbbc4-7be6-48a5-a5a5-c27528baa7ed tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1322 microversion: 2.1 time: 0.757607 Jan 17 21:20:45.488762 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 52/100] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:44 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1322 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:45.574423 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a3b7cd47-e1b3-46c4-a758-f79fef5d8340 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:45.576677 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a3b7cd47-e1b3-46c4-a758-f79fef5d8340 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:45.585788 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a3b7cd47-e1b3-46c4-a758-f79fef5d8340 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:45.588251 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a3b7cd47-e1b3-46c4-a758-f79fef5d8340 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:45.589656 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a3b7cd47-e1b3-46c4-a758-f79fef5d8340 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:45.591205 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a3b7cd47-e1b3-46c4-a758-f79fef5d8340 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:45.832085 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a3b7cd47-e1b3-46c4-a758-f79fef5d8340 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:45.842340 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a3b7cd47-e1b3-46c4-a758-f79fef5d8340 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.271776 Jan 17 21:20:45.843270 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 49/101] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:45 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:46.507836 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-da508ba4-aef3-46d5-977b-15217ad8a8ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:46.509570 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-da508ba4-aef3-46d5-977b-15217ad8a8ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:46.516708 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-da508ba4-aef3-46d5-977b-15217ad8a8ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:46.517149 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-da508ba4-aef3-46d5-977b-15217ad8a8ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:46.518446 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-da508ba4-aef3-46d5-977b-15217ad8a8ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:46.519037 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-da508ba4-aef3-46d5-977b-15217ad8a8ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:46.711835 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-da508ba4-aef3-46d5-977b-15217ad8a8ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:46.722859 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-da508ba4-aef3-46d5-977b-15217ad8a8ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1322 microversion: 2.1 time: 0.220209 Jan 17 21:20:46.723840 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 53/102] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:46 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:46.860862 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-27cec625-dbcc-4665-a7fd-a0ef95192606 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:46.862064 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-27cec625-dbcc-4665-a7fd-a0ef95192606 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:46.870021 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-27cec625-dbcc-4665-a7fd-a0ef95192606 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:46.872158 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-27cec625-dbcc-4665-a7fd-a0ef95192606 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:46.874719 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-27cec625-dbcc-4665-a7fd-a0ef95192606 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:46.875192 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-27cec625-dbcc-4665-a7fd-a0ef95192606 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:47.054359 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-27cec625-dbcc-4665-a7fd-a0ef95192606 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:47.063619 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-27cec625-dbcc-4665-a7fd-a0ef95192606 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.207665 Jan 17 21:20:47.064196 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 50/103] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:46 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:47.739820 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4edda1ec-23d4-489d-b39a-11fa388c0404 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:47.741225 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4edda1ec-23d4-489d-b39a-11fa388c0404 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:47.747426 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4edda1ec-23d4-489d-b39a-11fa388c0404 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:47.747964 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4edda1ec-23d4-489d-b39a-11fa388c0404 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:47.749190 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4edda1ec-23d4-489d-b39a-11fa388c0404 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:47.749840 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4edda1ec-23d4-489d-b39a-11fa388c0404 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:48.001606 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4edda1ec-23d4-489d-b39a-11fa388c0404 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:48.011182 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4edda1ec-23d4-489d-b39a-11fa388c0404 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1322 microversion: 2.1 time: 0.274651 Jan 17 21:20:48.012404 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 54/104] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:47 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:48.080474 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-246bb2b0-4d28-4f4e-bb46-e02b2f416e95 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:48.081087 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-246bb2b0-4d28-4f4e-bb46-e02b2f416e95 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:48.087508 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-246bb2b0-4d28-4f4e-bb46-e02b2f416e95 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:48.087964 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-246bb2b0-4d28-4f4e-bb46-e02b2f416e95 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:48.088963 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-246bb2b0-4d28-4f4e-bb46-e02b2f416e95 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:48.089406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-246bb2b0-4d28-4f4e-bb46-e02b2f416e95 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:48.251776 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-246bb2b0-4d28-4f4e-bb46-e02b2f416e95 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:48.259457 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-246bb2b0-4d28-4f4e-bb46-e02b2f416e95 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.182708 Jan 17 21:20:48.260531 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 51/105] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:48 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:49.030768 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4a7fe2e1-c8f8-4c41-91e3-752dc93886d2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:49.031299 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4a7fe2e1-c8f8-4c41-91e3-752dc93886d2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:49.037958 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a7fe2e1-c8f8-4c41-91e3-752dc93886d2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:49.038567 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a7fe2e1-c8f8-4c41-91e3-752dc93886d2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:49.040228 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a7fe2e1-c8f8-4c41-91e3-752dc93886d2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:49.040974 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a7fe2e1-c8f8-4c41-91e3-752dc93886d2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:49.240853 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4a7fe2e1-c8f8-4c41-91e3-752dc93886d2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:49.250288 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4a7fe2e1-c8f8-4c41-91e3-752dc93886d2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1322 microversion: 2.1 time: 0.224978 Jan 17 21:20:49.250877 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 55/106] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:49 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:49.277534 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-56929b69-a4a6-405e-b7fc-f480f10dd935 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:49.278162 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-56929b69-a4a6-405e-b7fc-f480f10dd935 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:49.285516 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-56929b69-a4a6-405e-b7fc-f480f10dd935 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:49.285996 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-56929b69-a4a6-405e-b7fc-f480f10dd935 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:49.286760 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-56929b69-a4a6-405e-b7fc-f480f10dd935 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:49.287205 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-56929b69-a4a6-405e-b7fc-f480f10dd935 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:49.470418 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-56929b69-a4a6-405e-b7fc-f480f10dd935 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:49.480270 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-56929b69-a4a6-405e-b7fc-f480f10dd935 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.207137 Jan 17 21:20:49.481439 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 52/107] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:49 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:50.266420 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-83993e8f-496a-47b0-b8d9-80eb5e17c5fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:50.267027 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-83993e8f-496a-47b0-b8d9-80eb5e17c5fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:50.273637 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83993e8f-496a-47b0-b8d9-80eb5e17c5fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:50.274228 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83993e8f-496a-47b0-b8d9-80eb5e17c5fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:50.275104 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83993e8f-496a-47b0-b8d9-80eb5e17c5fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:50.275623 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83993e8f-496a-47b0-b8d9-80eb5e17c5fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:50.454654 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-83993e8f-496a-47b0-b8d9-80eb5e17c5fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:50.454654 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-83993e8f-496a-47b0-b8d9-80eb5e17c5fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1322 microversion: 2.1 time: 0.190645 Jan 17 21:20:50.464110 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 56/108] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:50 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:50.497159 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-aaeb3d43-8f8f-4fd8-ae3d-15cab9691d3f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:50.497773 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-aaeb3d43-8f8f-4fd8-ae3d-15cab9691d3f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:50.503690 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-aaeb3d43-8f8f-4fd8-ae3d-15cab9691d3f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:50.504334 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-aaeb3d43-8f8f-4fd8-ae3d-15cab9691d3f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:50.505146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-aaeb3d43-8f8f-4fd8-ae3d-15cab9691d3f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:50.505596 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-aaeb3d43-8f8f-4fd8-ae3d-15cab9691d3f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:50.666615 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-aaeb3d43-8f8f-4fd8-ae3d-15cab9691d3f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:50.675441 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-aaeb3d43-8f8f-4fd8-ae3d-15cab9691d3f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.181484 Jan 17 21:20:50.676500 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 53/109] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:50 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:51.471496 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3eaaa9c8-7b1e-4fb8-911c-c585f8fc302c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:51.472512 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3eaaa9c8-7b1e-4fb8-911c-c585f8fc302c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:51.483288 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3eaaa9c8-7b1e-4fb8-911c-c585f8fc302c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:51.485399 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3eaaa9c8-7b1e-4fb8-911c-c585f8fc302c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:51.488041 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3eaaa9c8-7b1e-4fb8-911c-c585f8fc302c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:51.488533 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3eaaa9c8-7b1e-4fb8-911c-c585f8fc302c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:51.638748 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3eaaa9c8-7b1e-4fb8-911c-c585f8fc302c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:51.646009 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3eaaa9c8-7b1e-4fb8-911c-c585f8fc302c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1322 microversion: 2.1 time: 0.178319 Jan 17 21:20:51.646576 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 57/110] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:51 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:51.691563 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-704e794e-6584-41ad-8622-bce902f29054 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:51.692179 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-704e794e-6584-41ad-8622-bce902f29054 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:51.700360 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-704e794e-6584-41ad-8622-bce902f29054 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:51.701876 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-704e794e-6584-41ad-8622-bce902f29054 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:51.704620 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-704e794e-6584-41ad-8622-bce902f29054 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:51.705079 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-704e794e-6584-41ad-8622-bce902f29054 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:51.856596 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-704e794e-6584-41ad-8622-bce902f29054 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:51.864159 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-704e794e-6584-41ad-8622-bce902f29054 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.176118 Jan 17 21:20:51.864758 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 54/111] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:51 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:52.665248 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b24566b0-a457-435f-bb1e-63321f664dc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:52.668266 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b24566b0-a457-435f-bb1e-63321f664dc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:52.676212 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b24566b0-a457-435f-bb1e-63321f664dc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:52.677660 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b24566b0-a457-435f-bb1e-63321f664dc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:52.679040 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b24566b0-a457-435f-bb1e-63321f664dc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:52.680131 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b24566b0-a457-435f-bb1e-63321f664dc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:52.829790 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b24566b0-a457-435f-bb1e-63321f664dc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:52.838084 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b24566b0-a457-435f-bb1e-63321f664dc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1322 microversion: 2.1 time: 0.176866 Jan 17 21:20:52.838650 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 58/112] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:52 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:52.880961 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a849f5fd-10d3-4f6d-8c4e-1cd4669818f9 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:52.881974 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a849f5fd-10d3-4f6d-8c4e-1cd4669818f9 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:52.888544 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a849f5fd-10d3-4f6d-8c4e-1cd4669818f9 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:52.889072 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a849f5fd-10d3-4f6d-8c4e-1cd4669818f9 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:52.890026 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a849f5fd-10d3-4f6d-8c4e-1cd4669818f9 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:52.890467 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a849f5fd-10d3-4f6d-8c4e-1cd4669818f9 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:53.119324 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a849f5fd-10d3-4f6d-8c4e-1cd4669818f9 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:53.129748 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a849f5fd-10d3-4f6d-8c4e-1cd4669818f9 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.252346 Jan 17 21:20:53.130675 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 55/113] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:52 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:53.858195 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a2f77e4c-9942-49a5-be8a-d7e81d47fcd7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:53.858853 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a2f77e4c-9942-49a5-be8a-d7e81d47fcd7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:53.870396 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a2f77e4c-9942-49a5-be8a-d7e81d47fcd7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:53.871176 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a2f77e4c-9942-49a5-be8a-d7e81d47fcd7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:53.873266 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a2f77e4c-9942-49a5-be8a-d7e81d47fcd7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:53.873999 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a2f77e4c-9942-49a5-be8a-d7e81d47fcd7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:54.066985 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-a2f77e4c-9942-49a5-be8a-d7e81d47fcd7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:54.083075 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a2f77e4c-9942-49a5-be8a-d7e81d47fcd7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1322 microversion: 2.1 time: 0.228373 Jan 17 21:20:54.083739 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 59/114] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:53 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:20:54.146936 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-79519aa6-e4d4-4cb4-8a8a-e08a39c8a7b7 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:54.147589 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-79519aa6-e4d4-4cb4-8a8a-e08a39c8a7b7 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:54.154536 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-79519aa6-e4d4-4cb4-8a8a-e08a39c8a7b7 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:54.155760 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-79519aa6-e4d4-4cb4-8a8a-e08a39c8a7b7 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:54.156573 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-79519aa6-e4d4-4cb4-8a8a-e08a39c8a7b7 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:54.157227 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-79519aa6-e4d4-4cb4-8a8a-e08a39c8a7b7 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:54.321298 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-79519aa6-e4d4-4cb4-8a8a-e08a39c8a7b7 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:54.329965 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-79519aa6-e4d4-4cb4-8a8a-e08a39c8a7b7 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.186647 Jan 17 21:20:54.330543 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 56/115] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:54 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:55.099758 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a3b8bf68-5e88-4188-a01b-c43c3113708b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:55.104721 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a3b8bf68-5e88-4188-a01b-c43c3113708b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:55.108090 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a3b8bf68-5e88-4188-a01b-c43c3113708b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:55.109637 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a3b8bf68-5e88-4188-a01b-c43c3113708b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:55.110440 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a3b8bf68-5e88-4188-a01b-c43c3113708b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:55.110886 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a3b8bf68-5e88-4188-a01b-c43c3113708b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:55.348877 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e44a57d2-3560-458d-ab45-27a30c619ddb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:55.350485 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e44a57d2-3560-458d-ab45-27a30c619ddb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:55.359706 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e44a57d2-3560-458d-ab45-27a30c619ddb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:55.360254 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e44a57d2-3560-458d-ab45-27a30c619ddb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:55.362573 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e44a57d2-3560-458d-ab45-27a30c619ddb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:55.363230 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e44a57d2-3560-458d-ab45-27a30c619ddb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:55.425778 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-a3b8bf68-5e88-4188-a01b-c43c3113708b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:55.434508 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a3b8bf68-5e88-4188-a01b-c43c3113708b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1322 microversion: 2.1 time: 0.338226 Jan 17 21:20:55.445769 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 60/116] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:55 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:55.687341 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-e44a57d2-3560-458d-ab45-27a30c619ddb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:55.702274 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e44a57d2-3560-458d-ab45-27a30c619ddb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.359219 Jan 17 21:20:55.705311 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 57/117] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:55 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:20:56.452309 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b708adb2-2f62-4d57-aba8-d062047289b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:56.453053 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b708adb2-2f62-4d57-aba8-d062047289b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:56.463754 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b708adb2-2f62-4d57-aba8-d062047289b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:56.470108 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b708adb2-2f62-4d57-aba8-d062047289b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:56.471901 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b708adb2-2f62-4d57-aba8-d062047289b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:56.474776 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b708adb2-2f62-4d57-aba8-d062047289b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:56.730513 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f897e670-50de-4685-8c13-194667231a23 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:56.733644 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f897e670-50de-4685-8c13-194667231a23 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:56.756952 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f897e670-50de-4685-8c13-194667231a23 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:56.761382 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f897e670-50de-4685-8c13-194667231a23 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:56.763756 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f897e670-50de-4685-8c13-194667231a23 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:56.764219 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f897e670-50de-4685-8c13-194667231a23 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:56.843545 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b708adb2-2f62-4d57-aba8-d062047289b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:56.853309 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b708adb2-2f62-4d57-aba8-d062047289b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1322 microversion: 2.1 time: 0.405756 Jan 17 21:20:56.864625 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 61/118] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:56 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:57.041057 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f897e670-50de-4685-8c13-194667231a23 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:57.059096 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f897e670-50de-4685-8c13-194667231a23 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.331020 Jan 17 21:20:57.062814 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 58/119] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:56 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:20:57.188633 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-bdd99001-99a0-42c4-9c9c-62cd5dfc72b3 req-698d0bfc-2f45-444e-a2ab-b66fb4bf3ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "069fd10f-3002-4910-884d-0bfc2697b631", "name": "network-vif-plugged", "status": "completed", "tag": "6bbdf179-7baf-44c9-8cb0-3aa9f2f9d689"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:20:57.191716 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:20:57.191716 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:20:57.208302 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-bdd99001-99a0-42c4-9c9c-62cd5dfc72b3 req-698d0bfc-2f45-444e-a2ab-b66fb4bf3ace service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:57.212071 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-bdd99001-99a0-42c4-9c9c-62cd5dfc72b3 req-698d0bfc-2f45-444e-a2ab-b66fb4bf3ace service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:57.241579 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-bdd99001-99a0-42c4-9c9c-62cd5dfc72b3 req-698d0bfc-2f45-444e-a2ab-b66fb4bf3ace service nova] Creating event network-vif-plugged:6bbdf179-7baf-44c9-8cb0-3aa9f2f9d689 for instance 069fd10f-3002-4910-884d-0bfc2697b631 on hv-cinder-82489 Jan 17 21:20:57.256029 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-bdd99001-99a0-42c4-9c9c-62cd5dfc72b3 req-698d0bfc-2f45-444e-a2ab-b66fb4bf3ace service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.390092 Jan 17 21:20:57.256664 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 62/120] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:20:57.872206 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-bed06fa7-135e-410a-80c9-dd82fa8a0e3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:57.872899 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-bed06fa7-135e-410a-80c9-dd82fa8a0e3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:57.881862 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bed06fa7-135e-410a-80c9-dd82fa8a0e3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:57.883249 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bed06fa7-135e-410a-80c9-dd82fa8a0e3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:57.884572 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bed06fa7-135e-410a-80c9-dd82fa8a0e3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:57.885363 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bed06fa7-135e-410a-80c9-dd82fa8a0e3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:58.080030 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8c2cbd48-1721-4703-8179-100fc90bd3d6 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:58.080794 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8c2cbd48-1721-4703-8179-100fc90bd3d6 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:58.093923 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8c2cbd48-1721-4703-8179-100fc90bd3d6 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:58.094390 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8c2cbd48-1721-4703-8179-100fc90bd3d6 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:58.096777 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8c2cbd48-1721-4703-8179-100fc90bd3d6 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:58.102373 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8c2cbd48-1721-4703-8179-100fc90bd3d6 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:58.123047 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-bed06fa7-135e-410a-80c9-dd82fa8a0e3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:58.134001 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-bed06fa7-135e-410a-80c9-dd82fa8a0e3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1322 microversion: 2.1 time: 0.267257 Jan 17 21:20:58.135090 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 59/121] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:57 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:58.379212 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8c2cbd48-1721-4703-8179-100fc90bd3d6 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:58.390939 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8c2cbd48-1721-4703-8179-100fc90bd3d6 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.317385 Jan 17 21:20:58.404716 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 63/122] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:58 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:20:59.151743 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-45420dc8-8f88-4fec-966e-b1bc636ca46b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:59.155186 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-45420dc8-8f88-4fec-966e-b1bc636ca46b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:59.165033 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-45420dc8-8f88-4fec-966e-b1bc636ca46b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:59.165792 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-45420dc8-8f88-4fec-966e-b1bc636ca46b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:59.166893 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-45420dc8-8f88-4fec-966e-b1bc636ca46b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:59.168333 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-45420dc8-8f88-4fec-966e-b1bc636ca46b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:59.309481 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-3d834637-8293-414d-a034-c5f36ebb025f req-3750053a-8bf0-4a48-abfd-041c5bbd1e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0057c90-b41a-4cd1-a9fa-01cb2da4fef6", "name": "network-vif-plugged", "status": "completed", "tag": "97a2a727-ca87-4934-94e8-4e197d2e3622"}, {"server_uuid": "8a5818e4-0026-4597-9ef3-d539c2cdee97", "name": "network-vif-plugged", "status": "completed", "tag": "138d0a50-2135-4dee-95fa-28ecdc541d3d"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:20:59.311751 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:20:59.311751 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:20:59.325983 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-3d834637-8293-414d-a034-c5f36ebb025f req-3750053a-8bf0-4a48-abfd-041c5bbd1e40 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:59.326973 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-3d834637-8293-414d-a034-c5f36ebb025f req-3750053a-8bf0-4a48-abfd-041c5bbd1e40 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:59.346625 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-3d834637-8293-414d-a034-c5f36ebb025f req-3750053a-8bf0-4a48-abfd-041c5bbd1e40 service nova] Creating event network-vif-plugged:97a2a727-ca87-4934-94e8-4e197d2e3622 for instance e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 on hv-cinder-82489 Jan 17 21:20:59.347140 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-3d834637-8293-414d-a034-c5f36ebb025f req-3750053a-8bf0-4a48-abfd-041c5bbd1e40 service nova] Creating event network-vif-plugged:138d0a50-2135-4dee-95fa-28ecdc541d3d for instance 8a5818e4-0026-4597-9ef3-d539c2cdee97 on hv-cinder-82489 Jan 17 21:20:59.362123 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-3d834637-8293-414d-a034-c5f36ebb025f req-3750053a-8bf0-4a48-abfd-041c5bbd1e40 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056185 Jan 17 21:20:59.363649 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 64/123] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:20:59.408301 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2161607e-56f2-40f9-ba39-670df3ae5e00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:20:59.411180 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2161607e-56f2-40f9-ba39-670df3ae5e00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:20:59.419823 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2161607e-56f2-40f9-ba39-670df3ae5e00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:59.420292 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2161607e-56f2-40f9-ba39-670df3ae5e00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:59.421371 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2161607e-56f2-40f9-ba39-670df3ae5e00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:20:59.422006 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2161607e-56f2-40f9-ba39-670df3ae5e00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:20:59.713497 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-45420dc8-8f88-4fec-966e-b1bc636ca46b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:59.719065 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2161607e-56f2-40f9-ba39-670df3ae5e00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:20:59.733353 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-45420dc8-8f88-4fec-966e-b1bc636ca46b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1322 microversion: 2.1 time: 0.586139 Jan 17 21:20:59.734001 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2161607e-56f2-40f9-ba39-670df3ae5e00 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1315 microversion: 2.1 time: 0.328404 Jan 17 21:20:59.734595 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 65/124] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:59 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:20:59.745203 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 60/125] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:20:59 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1322 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:00.750779 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d84eccab-297f-4b7d-92a8-0edb80b45e62 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:00.751805 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d84eccab-297f-4b7d-92a8-0edb80b45e62 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:00.758929 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fdaad338-05e7-415f-a49d-761d6a7af5e1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:00.760108 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fdaad338-05e7-415f-a49d-761d6a7af5e1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:00.767766 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fdaad338-05e7-415f-a49d-761d6a7af5e1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:00.768086 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fdaad338-05e7-415f-a49d-761d6a7af5e1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:00.768896 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fdaad338-05e7-415f-a49d-761d6a7af5e1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:00.769342 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fdaad338-05e7-415f-a49d-761d6a7af5e1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:00.774918 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d84eccab-297f-4b7d-92a8-0edb80b45e62 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:00.775565 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d84eccab-297f-4b7d-92a8-0edb80b45e62 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:00.776560 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d84eccab-297f-4b7d-92a8-0edb80b45e62 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:00.777145 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d84eccab-297f-4b7d-92a8-0edb80b45e62 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:01.000721 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-fdaad338-05e7-415f-a49d-761d6a7af5e1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:01.010201 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fdaad338-05e7-415f-a49d-761d6a7af5e1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1322 microversion: 2.1 time: 0.254722 Jan 17 21:21:01.011132 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 61/126] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:00 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:01.015151 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-d84eccab-297f-4b7d-92a8-0edb80b45e62 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:01.025915 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d84eccab-297f-4b7d-92a8-0edb80b45e62 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1501 microversion: 2.1 time: 0.278381 Jan 17 21:21:01.041746 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 66/127] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:00 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1501 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:02.029039 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-052388c2-20da-4743-82ec-21e159f4d62c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:02.030348 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-052388c2-20da-4743-82ec-21e159f4d62c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:02.037082 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-052388c2-20da-4743-82ec-21e159f4d62c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:02.037675 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-052388c2-20da-4743-82ec-21e159f4d62c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:02.038610 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-052388c2-20da-4743-82ec-21e159f4d62c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:02.039176 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-052388c2-20da-4743-82ec-21e159f4d62c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:02.196957 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-052388c2-20da-4743-82ec-21e159f4d62c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:02.204480 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-052388c2-20da-4743-82ec-21e159f4d62c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1516 microversion: 2.1 time: 0.179834 Jan 17 21:21:02.205308 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 62/128] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:02 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:02.222349 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e5d2171d-7501-4e94-9c5b-c972c7a1ef46 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:21:02.223302 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-e5d2171d-7501-4e94-9c5b-c972c7a1ef46 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:02.229304 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e5d2171d-7501-4e94-9c5b-c972c7a1ef46 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:02.229767 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e5d2171d-7501-4e94-9c5b-c972c7a1ef46 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:02.234093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e5d2171d-7501-4e94-9c5b-c972c7a1ef46 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:02.234561 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e5d2171d-7501-4e94-9c5b-c972c7a1ef46 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:02.295912 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.objects.instance [None req-e5d2171d-7501-4e94-9c5b-c972c7a1ef46 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lazy-loading 'flavor' on Instance uuid e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 {{(pid=116183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:21:02.419484 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e5d2171d-7501-4e94-9c5b-c972c7a1ef46 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "POST /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6/action" status: 200 len: 32 microversion: 2.1 time: 0.200654 Jan 17 21:21:02.420411 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 67/129] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:21:02 2022] POST /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6/action => generated 32 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:21:02.433294 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c6979d3e-3086-4ff3-aab9-117a615518a5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:02.434310 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c6979d3e-3086-4ff3-aab9-117a615518a5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:02.444435 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c6979d3e-3086-4ff3-aab9-117a615518a5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:02.445754 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c6979d3e-3086-4ff3-aab9-117a615518a5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:02.449188 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c6979d3e-3086-4ff3-aab9-117a615518a5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:02.449652 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c6979d3e-3086-4ff3-aab9-117a615518a5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:02.592155 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f6379f44-805d-4aba-9615-39363a14ba9f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a713563-443e-472f-b3b6-3113fe424d52"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:21:02.593430 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f6379f44-805d-4aba-9615-39363a14ba9f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:02.605166 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f6379f44-805d-4aba-9615-39363a14ba9f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:02.606561 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f6379f44-805d-4aba-9615-39363a14ba9f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:02.608129 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f6379f44-805d-4aba-9615-39363a14ba9f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:02.609619 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f6379f44-805d-4aba-9615-39363a14ba9f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:02.713491 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c6979d3e-3086-4ff3-aab9-117a615518a5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:02.727811 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c6979d3e-3086-4ff3-aab9-117a615518a5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.299935 Jan 17 21:21:02.728620 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 63/130] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:02 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:03.173368 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f6379f44-805d-4aba-9615-39363a14ba9f tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "POST /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.586175 Jan 17 21:21:03.174281 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 68/131] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jan 17 21:21:02 2022] POST /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631/os-volume_attachments => generated 194 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:21:03.747203 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4418717f-d103-4f5c-bcc9-b15b5425e76b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:03.748067 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4418717f-d103-4f5c-bcc9-b15b5425e76b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:03.759331 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4418717f-d103-4f5c-bcc9-b15b5425e76b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:03.760314 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4418717f-d103-4f5c-bcc9-b15b5425e76b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:03.761879 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4418717f-d103-4f5c-bcc9-b15b5425e76b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:03.764150 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4418717f-d103-4f5c-bcc9-b15b5425e76b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:03.973788 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4418717f-d103-4f5c-bcc9-b15b5425e76b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:03.981765 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4418717f-d103-4f5c-bcc9-b15b5425e76b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.238693 Jan 17 21:21:03.982393 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 64/132] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:03 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:04.999732 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-aa2ff6bf-1573-43e8-8428-de08124b93db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:05.000518 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-aa2ff6bf-1573-43e8-8428-de08124b93db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:05.009162 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-aa2ff6bf-1573-43e8-8428-de08124b93db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:05.009625 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-aa2ff6bf-1573-43e8-8428-de08124b93db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:05.010514 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-aa2ff6bf-1573-43e8-8428-de08124b93db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:05.010862 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-aa2ff6bf-1573-43e8-8428-de08124b93db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:05.224029 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-aa2ff6bf-1573-43e8-8428-de08124b93db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:05.233931 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-aa2ff6bf-1573-43e8-8428-de08124b93db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.238047 Jan 17 21:21:05.243648 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 69/133] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:04 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:06.252677 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b44e2288-2431-46ed-9018-860e30c5e637 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:06.254653 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b44e2288-2431-46ed-9018-860e30c5e637 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:06.270945 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b44e2288-2431-46ed-9018-860e30c5e637 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:06.272100 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b44e2288-2431-46ed-9018-860e30c5e637 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:06.273621 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b44e2288-2431-46ed-9018-860e30c5e637 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:06.280764 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b44e2288-2431-46ed-9018-860e30c5e637 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:06.455655 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b44e2288-2431-46ed-9018-860e30c5e637 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:06.466254 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b44e2288-2431-46ed-9018-860e30c5e637 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.218835 Jan 17 21:21:06.467219 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 65/134] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:06 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:07.484496 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-127a61ee-2927-4525-8bba-1ad255716d65 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:07.485860 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-127a61ee-2927-4525-8bba-1ad255716d65 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:07.494821 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-127a61ee-2927-4525-8bba-1ad255716d65 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:07.495247 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-127a61ee-2927-4525-8bba-1ad255716d65 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:07.496187 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-127a61ee-2927-4525-8bba-1ad255716d65 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:07.507516 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-127a61ee-2927-4525-8bba-1ad255716d65 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:07.703487 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-127a61ee-2927-4525-8bba-1ad255716d65 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:07.712728 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-127a61ee-2927-4525-8bba-1ad255716d65 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.233274 Jan 17 21:21:07.713649 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 70/135] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:07 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:08.739455 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-559ef67a-5cfd-4e0c-91b1-b85fd1b68a41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:08.740075 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-559ef67a-5cfd-4e0c-91b1-b85fd1b68a41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:08.746886 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-559ef67a-5cfd-4e0c-91b1-b85fd1b68a41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:08.747427 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-559ef67a-5cfd-4e0c-91b1-b85fd1b68a41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:08.748283 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-559ef67a-5cfd-4e0c-91b1-b85fd1b68a41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:08.748864 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-559ef67a-5cfd-4e0c-91b1-b85fd1b68a41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:08.883186 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-559ef67a-5cfd-4e0c-91b1-b85fd1b68a41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:08.890654 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-559ef67a-5cfd-4e0c-91b1-b85fd1b68a41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.154850 Jan 17 21:21:08.891220 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 66/136] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:08 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:09.907228 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-934f10ed-008e-4150-a221-b86666c06a47 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:09.907773 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-934f10ed-008e-4150-a221-b86666c06a47 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:09.914929 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-934f10ed-008e-4150-a221-b86666c06a47 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:09.915576 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-934f10ed-008e-4150-a221-b86666c06a47 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:09.916624 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-934f10ed-008e-4150-a221-b86666c06a47 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:09.917169 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-934f10ed-008e-4150-a221-b86666c06a47 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:10.049004 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-934f10ed-008e-4150-a221-b86666c06a47 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:10.056790 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-934f10ed-008e-4150-a221-b86666c06a47 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.153341 Jan 17 21:21:10.057356 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 71/137] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:09 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:11.073420 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-77135806-d01b-4114-af80-0ca7d1a32ef2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:11.077059 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-77135806-d01b-4114-af80-0ca7d1a32ef2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:11.080227 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77135806-d01b-4114-af80-0ca7d1a32ef2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:11.080717 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77135806-d01b-4114-af80-0ca7d1a32ef2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:11.081517 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77135806-d01b-4114-af80-0ca7d1a32ef2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:11.081953 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77135806-d01b-4114-af80-0ca7d1a32ef2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:11.229275 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-77135806-d01b-4114-af80-0ca7d1a32ef2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:11.236888 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-77135806-d01b-4114-af80-0ca7d1a32ef2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.167048 Jan 17 21:21:11.237463 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 67/138] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:11 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:12.255134 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1ebc3da5-20af-4b58-b585-cb032b97e3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:12.255964 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1ebc3da5-20af-4b58-b585-cb032b97e3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:12.263144 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1ebc3da5-20af-4b58-b585-cb032b97e3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:12.263627 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1ebc3da5-20af-4b58-b585-cb032b97e3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:12.264468 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1ebc3da5-20af-4b58-b585-cb032b97e3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:12.264917 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1ebc3da5-20af-4b58-b585-cb032b97e3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:12.439306 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1ebc3da5-20af-4b58-b585-cb032b97e3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:12.447769 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1ebc3da5-20af-4b58-b585-cb032b97e3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.196573 Jan 17 21:21:12.448585 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 72/139] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:12 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:13.479747 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5c5098ab-0104-46a9-99d4-3bf261c76adf tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:13.481205 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5c5098ab-0104-46a9-99d4-3bf261c76adf tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:13.495247 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5c5098ab-0104-46a9-99d4-3bf261c76adf tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:13.495944 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5c5098ab-0104-46a9-99d4-3bf261c76adf tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:13.497207 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5c5098ab-0104-46a9-99d4-3bf261c76adf tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:13.497953 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5c5098ab-0104-46a9-99d4-3bf261c76adf tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:13.670013 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5c5098ab-0104-46a9-99d4-3bf261c76adf tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:13.678974 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5c5098ab-0104-46a9-99d4-3bf261c76adf tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.215269 Jan 17 21:21:13.679662 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 68/140] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:13 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:14.252135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-20a9d66f-84ee-4841-835b-eb5e5a265deb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:14.253146 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-20a9d66f-84ee-4841-835b-eb5e5a265deb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:14.260039 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-20a9d66f-84ee-4841-835b-eb5e5a265deb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:14.260536 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-20a9d66f-84ee-4841-835b-eb5e5a265deb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:14.261342 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-20a9d66f-84ee-4841-835b-eb5e5a265deb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:14.261844 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-20a9d66f-84ee-4841-835b-eb5e5a265deb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:14.290870 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-20a9d66f-84ee-4841-835b-eb5e5a265deb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Going to try to terminate instance {{(pid=116183) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:21:14.402469 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-20a9d66f-84ee-4841-835b-eb5e5a265deb tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "DELETE /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 204 len: 0 microversion: 2.1 time: 0.152110 Jan 17 21:21:14.408504 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 73/141] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:21:14 2022] DELETE /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:21:14.412962 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1b2c60cf-b838-4df5-9729-65cb0763a061 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:14.414581 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1b2c60cf-b838-4df5-9729-65cb0763a061 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:14.422014 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1b2c60cf-b838-4df5-9729-65cb0763a061 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:14.422710 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1b2c60cf-b838-4df5-9729-65cb0763a061 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:14.423948 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1b2c60cf-b838-4df5-9729-65cb0763a061 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:14.425152 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1b2c60cf-b838-4df5-9729-65cb0763a061 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:14.599406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1b2c60cf-b838-4df5-9729-65cb0763a061 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:14.609036 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1b2c60cf-b838-4df5-9729-65cb0763a061 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1553 microversion: 2.1 time: 0.199129 Jan 17 21:21:14.610621 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 69/142] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:14 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:21:14.698931 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5a4e53fa-7f3f-458c-96df-129aea7dc760 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:14.700610 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5a4e53fa-7f3f-458c-96df-129aea7dc760 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:14.709274 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5a4e53fa-7f3f-458c-96df-129aea7dc760 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:14.710014 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5a4e53fa-7f3f-458c-96df-129aea7dc760 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:14.711080 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5a4e53fa-7f3f-458c-96df-129aea7dc760 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:14.711596 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5a4e53fa-7f3f-458c-96df-129aea7dc760 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:14.971169 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5a4e53fa-7f3f-458c-96df-129aea7dc760 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:14.987367 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5a4e53fa-7f3f-458c-96df-129aea7dc760 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.295237 Jan 17 21:21:14.990187 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 74/143] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:14 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:15.628138 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5091e5bb-e74a-43b1-bd0c-31663d8d665d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:15.628999 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5091e5bb-e74a-43b1-bd0c-31663d8d665d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:15.635145 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5091e5bb-e74a-43b1-bd0c-31663d8d665d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:15.635601 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5091e5bb-e74a-43b1-bd0c-31663d8d665d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:15.636805 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5091e5bb-e74a-43b1-bd0c-31663d8d665d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:15.637287 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5091e5bb-e74a-43b1-bd0c-31663d8d665d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:15.807943 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5091e5bb-e74a-43b1-bd0c-31663d8d665d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:15.824926 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5091e5bb-e74a-43b1-bd0c-31663d8d665d tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1553 microversion: 2.1 time: 0.199873 Jan 17 21:21:15.825512 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 70/144] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:15 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:21:16.011204 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-149db92f-a5e9-4cb5-9da8-8e6af1881fc6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:16.012241 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-149db92f-a5e9-4cb5-9da8-8e6af1881fc6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:16.022833 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-149db92f-a5e9-4cb5-9da8-8e6af1881fc6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:16.023806 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-149db92f-a5e9-4cb5-9da8-8e6af1881fc6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:16.024641 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-149db92f-a5e9-4cb5-9da8-8e6af1881fc6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:16.025318 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-149db92f-a5e9-4cb5-9da8-8e6af1881fc6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:16.409291 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-149db92f-a5e9-4cb5-9da8-8e6af1881fc6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:16.418196 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-149db92f-a5e9-4cb5-9da8-8e6af1881fc6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.414963 Jan 17 21:21:16.418837 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 75/145] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:16 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:21:16.845104 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2bdea810-f13c-45dc-9418-686ac6fc4e4c tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:16.845861 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2bdea810-f13c-45dc-9418-686ac6fc4e4c tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:16.852803 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2bdea810-f13c-45dc-9418-686ac6fc4e4c tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:16.853362 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2bdea810-f13c-45dc-9418-686ac6fc4e4c tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:16.854244 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2bdea810-f13c-45dc-9418-686ac6fc4e4c tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:16.854949 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2bdea810-f13c-45dc-9418-686ac6fc4e4c tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:17.184043 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2bdea810-f13c-45dc-9418-686ac6fc4e4c tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:17.201253 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2bdea810-f13c-45dc-9418-686ac6fc4e4c tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1553 microversion: 2.1 time: 0.359473 Jan 17 21:21:17.202605 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 71/146] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:16 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1553 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:17.441554 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-90436a03-b25d-433f-828a-31678fbd0cdc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:17.442362 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-90436a03-b25d-433f-828a-31678fbd0cdc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:17.455105 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-90436a03-b25d-433f-828a-31678fbd0cdc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:17.458465 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-90436a03-b25d-433f-828a-31678fbd0cdc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:17.459452 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-90436a03-b25d-433f-828a-31678fbd0cdc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:17.463941 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-90436a03-b25d-433f-828a-31678fbd0cdc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:17.766406 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-90436a03-b25d-433f-828a-31678fbd0cdc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:17.780999 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-90436a03-b25d-433f-828a-31678fbd0cdc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.340829 Jan 17 21:21:17.781689 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 76/147] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:17 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:18.088556 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-af4b6507-4afb-4fd1-99d5-dc698b530299 req-b8e5549e-7784-41e9-9c3c-43f0197b60f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "069fd10f-3002-4910-884d-0bfc2697b631", "name": "network-vif-deleted", "tag": "6bbdf179-7baf-44c9-8cb0-3aa9f2f9d689"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:21:18.092825 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:21:18.092825 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:21:18.105747 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-af4b6507-4afb-4fd1-99d5-dc698b530299 req-b8e5549e-7784-41e9-9c3c-43f0197b60f9 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:18.106553 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-af4b6507-4afb-4fd1-99d5-dc698b530299 req-b8e5549e-7784-41e9-9c3c-43f0197b60f9 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:18.135568 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-af4b6507-4afb-4fd1-99d5-dc698b530299 req-b8e5549e-7784-41e9-9c3c-43f0197b60f9 service nova] Creating event network-vif-deleted:6bbdf179-7baf-44c9-8cb0-3aa9f2f9d689 for instance 069fd10f-3002-4910-884d-0bfc2697b631 on hv-cinder-82489 Jan 17 21:21:18.148544 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-af4b6507-4afb-4fd1-99d5-dc698b530299 req-b8e5549e-7784-41e9-9c3c-43f0197b60f9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063973 Jan 17 21:21:18.150926 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 72/148] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:21:18.220252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b9b0b7f8-e6e5-4798-bea5-2f663b50778e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:18.220994 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b9b0b7f8-e6e5-4798-bea5-2f663b50778e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:18.229613 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b9b0b7f8-e6e5-4798-bea5-2f663b50778e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:18.230417 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b9b0b7f8-e6e5-4798-bea5-2f663b50778e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:18.231470 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b9b0b7f8-e6e5-4798-bea5-2f663b50778e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:18.232118 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b9b0b7f8-e6e5-4798-bea5-2f663b50778e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:18.307691 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b9b0b7f8-e6e5-4798-bea5-2f663b50778e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9190e92a314e5a8ca646fc9f972a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d304e800c1c44a5ae9dd3e05253a278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:18.315737 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b9b0b7f8-e6e5-4798-bea5-2f663b50778e tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 200 len: 1346 microversion: 2.1 time: 0.100176 Jan 17 21:21:18.316980 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 77/149] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:18 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 1346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:18.811403 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-9da86b9a-9f16-4bf8-9ee8-271abd1f6d62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:18.812108 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-9da86b9a-9f16-4bf8-9ee8-271abd1f6d62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:18.819436 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9da86b9a-9f16-4bf8-9ee8-271abd1f6d62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:18.820136 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9da86b9a-9f16-4bf8-9ee8-271abd1f6d62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:18.821186 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9da86b9a-9f16-4bf8-9ee8-271abd1f6d62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:18.821891 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9da86b9a-9f16-4bf8-9ee8-271abd1f6d62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:19.017920 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-9da86b9a-9f16-4bf8-9ee8-271abd1f6d62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:19.027961 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-9da86b9a-9f16-4bf8-9ee8-271abd1f6d62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.231845 Jan 17 21:21:19.028932 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 73/150] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:18 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:19.335258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-613efb8c-3920-43b6-87b4-0704eb32a6d0 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:19.335876 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-613efb8c-3920-43b6-87b4-0704eb32a6d0 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:19.347884 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-613efb8c-3920-43b6-87b4-0704eb32a6d0 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:19.349737 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-613efb8c-3920-43b6-87b4-0704eb32a6d0 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:19.353093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-613efb8c-3920-43b6-87b4-0704eb32a6d0 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:19.354711 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-613efb8c-3920-43b6-87b4-0704eb32a6d0 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:19.413208 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-613efb8c-3920-43b6-87b4-0704eb32a6d0 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] HTTP exception thrown: Instance 069fd10f-3002-4910-884d-0bfc2697b631 could not be found. Jan 17 21:21:19.414068 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-613efb8c-3920-43b6-87b4-0704eb32a6d0 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Returning 404 to user: Instance 069fd10f-3002-4910-884d-0bfc2697b631 could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:21:19.415139 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-613efb8c-3920-43b6-87b4-0704eb32a6d0 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 404 len: 111 microversion: 2.1 time: 0.084802 Jan 17 21:21:19.415596 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 78/151] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:19 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:21:19.557885 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f5e3924d-1a9b-4a1f-902a-c89f87955302 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:19.559483 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f5e3924d-1a9b-4a1f-902a-c89f87955302 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:19.565457 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f5e3924d-1a9b-4a1f-902a-c89f87955302 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:19.565912 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f5e3924d-1a9b-4a1f-902a-c89f87955302 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:19.566897 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f5e3924d-1a9b-4a1f-902a-c89f87955302 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:19.567536 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f5e3924d-1a9b-4a1f-902a-c89f87955302 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:19.618181 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-f5e3924d-1a9b-4a1f-902a-c89f87955302 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] HTTP exception thrown: Instance 069fd10f-3002-4910-884d-0bfc2697b631 could not be found. Jan 17 21:21:19.618790 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f5e3924d-1a9b-4a1f-902a-c89f87955302 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Returning 404 to user: Instance 069fd10f-3002-4910-884d-0bfc2697b631 could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:21:19.619632 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f5e3924d-1a9b-4a1f-902a-c89f87955302 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.066865 Jan 17 21:21:19.620354 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 74/152] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:21:19 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631/os-volume_attachments => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 17 21:21:20.046370 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-35ae935a-1246-47de-bfec-971ce08d6d6a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:20.047178 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-35ae935a-1246-47de-bfec-971ce08d6d6a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:20.054904 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-35ae935a-1246-47de-bfec-971ce08d6d6a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:20.055490 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-35ae935a-1246-47de-bfec-971ce08d6d6a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:20.056429 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-35ae935a-1246-47de-bfec-971ce08d6d6a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:20.057118 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-35ae935a-1246-47de-bfec-971ce08d6d6a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:20.290184 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-35ae935a-1246-47de-bfec-971ce08d6d6a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:20.298540 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-35ae935a-1246-47de-bfec-971ce08d6d6a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.255927 Jan 17 21:21:20.308414 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 79/153] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:20 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:21.316151 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-341bcb86-3de5-474a-a356-4713317c1555 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:21.316862 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-341bcb86-3de5-474a-a356-4713317c1555 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:21.324012 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-341bcb86-3de5-474a-a356-4713317c1555 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:21.324856 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-341bcb86-3de5-474a-a356-4713317c1555 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:21.326101 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-341bcb86-3de5-474a-a356-4713317c1555 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:21.327468 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-341bcb86-3de5-474a-a356-4713317c1555 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:21.473974 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-341bcb86-3de5-474a-a356-4713317c1555 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:21.482760 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-341bcb86-3de5-474a-a356-4713317c1555 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.170488 Jan 17 21:21:21.483269 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 75/154] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:21 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:21:22.500258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0dbe34aa-213d-4fd1-ba23-721771ad88d8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:22.501118 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-0dbe34aa-213d-4fd1-ba23-721771ad88d8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:22.508880 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0dbe34aa-213d-4fd1-ba23-721771ad88d8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:22.509570 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0dbe34aa-213d-4fd1-ba23-721771ad88d8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:22.510639 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0dbe34aa-213d-4fd1-ba23-721771ad88d8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:22.511147 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0dbe34aa-213d-4fd1-ba23-721771ad88d8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:22.680151 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-0dbe34aa-213d-4fd1-ba23-721771ad88d8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:22.687810 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-0dbe34aa-213d-4fd1-ba23-721771ad88d8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.191146 Jan 17 21:21:22.688698 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 80/155] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:22 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:23.705881 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-de75b7cf-92ca-4951-8e0c-becc18a33178 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:23.706495 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-de75b7cf-92ca-4951-8e0c-becc18a33178 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:23.712609 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-de75b7cf-92ca-4951-8e0c-becc18a33178 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:23.713065 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-de75b7cf-92ca-4951-8e0c-becc18a33178 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:23.713866 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-de75b7cf-92ca-4951-8e0c-becc18a33178 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:23.714307 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-de75b7cf-92ca-4951-8e0c-becc18a33178 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:23.948946 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-de75b7cf-92ca-4951-8e0c-becc18a33178 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:23.956759 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-de75b7cf-92ca-4951-8e0c-becc18a33178 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.254528 Jan 17 21:21:23.957426 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 76/156] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:23 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:24.974038 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4a46e301-ac0c-4938-9427-b357434b230c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:24.974670 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4a46e301-ac0c-4938-9427-b357434b230c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:24.981159 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a46e301-ac0c-4938-9427-b357434b230c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:24.981809 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a46e301-ac0c-4938-9427-b357434b230c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:24.982619 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a46e301-ac0c-4938-9427-b357434b230c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:24.983140 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a46e301-ac0c-4938-9427-b357434b230c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:25.138836 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4a46e301-ac0c-4938-9427-b357434b230c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:25.146475 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4a46e301-ac0c-4938-9427-b357434b230c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.175995 Jan 17 21:21:25.147595 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 81/157] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:24 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:26.164860 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fa696db4-4893-4e84-a308-10b26023f92b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:26.166066 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fa696db4-4893-4e84-a308-10b26023f92b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:26.173053 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fa696db4-4893-4e84-a308-10b26023f92b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:26.173506 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fa696db4-4893-4e84-a308-10b26023f92b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:26.174299 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fa696db4-4893-4e84-a308-10b26023f92b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:26.174740 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fa696db4-4893-4e84-a308-10b26023f92b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:26.334344 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-fa696db4-4893-4e84-a308-10b26023f92b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:26.343469 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fa696db4-4893-4e84-a308-10b26023f92b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.182835 Jan 17 21:21:26.344275 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 77/158] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:26 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:21:27.363584 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e37f791a-626f-4a76-9e12-9911ece6eb00 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:27.364203 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-e37f791a-626f-4a76-9e12-9911ece6eb00 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:27.370566 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e37f791a-626f-4a76-9e12-9911ece6eb00 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:27.371027 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e37f791a-626f-4a76-9e12-9911ece6eb00 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:27.371819 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e37f791a-626f-4a76-9e12-9911ece6eb00 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:27.372258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e37f791a-626f-4a76-9e12-9911ece6eb00 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:27.519377 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-e37f791a-626f-4a76-9e12-9911ece6eb00 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:27.527694 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e37f791a-626f-4a76-9e12-9911ece6eb00 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.167970 Jan 17 21:21:27.528288 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 82/159] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:27 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:28.544851 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-08c3b76a-e891-464f-8130-4b1d41d9c144 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:28.545467 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-08c3b76a-e891-464f-8130-4b1d41d9c144 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:28.551614 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08c3b76a-e891-464f-8130-4b1d41d9c144 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:28.552066 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08c3b76a-e891-464f-8130-4b1d41d9c144 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:28.552944 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08c3b76a-e891-464f-8130-4b1d41d9c144 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:28.553410 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08c3b76a-e891-464f-8130-4b1d41d9c144 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:28.697079 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-08c3b76a-e891-464f-8130-4b1d41d9c144 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:28.704821 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-08c3b76a-e891-464f-8130-4b1d41d9c144 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.163537 Jan 17 21:21:28.705422 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 78/160] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:28 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:29.725982 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-01aed88c-aa2d-43ea-a434-9ea8438835e6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:29.727020 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-01aed88c-aa2d-43ea-a434-9ea8438835e6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:29.736856 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-01aed88c-aa2d-43ea-a434-9ea8438835e6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:29.737580 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-01aed88c-aa2d-43ea-a434-9ea8438835e6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:29.738904 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-01aed88c-aa2d-43ea-a434-9ea8438835e6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:29.739635 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-01aed88c-aa2d-43ea-a434-9ea8438835e6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:29.888747 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-01aed88c-aa2d-43ea-a434-9ea8438835e6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:29.896063 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-01aed88c-aa2d-43ea-a434-9ea8438835e6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.176733 Jan 17 21:21:29.896869 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 83/161] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:29 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:30.913741 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-17eb61da-d1df-4d9a-bc24-533f032f3b05 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:30.914360 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-17eb61da-d1df-4d9a-bc24-533f032f3b05 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:30.920437 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-17eb61da-d1df-4d9a-bc24-533f032f3b05 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:30.920895 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-17eb61da-d1df-4d9a-bc24-533f032f3b05 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:30.921686 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-17eb61da-d1df-4d9a-bc24-533f032f3b05 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:30.922126 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-17eb61da-d1df-4d9a-bc24-533f032f3b05 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:31.057751 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-17eb61da-d1df-4d9a-bc24-533f032f3b05 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:31.065100 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-17eb61da-d1df-4d9a-bc24-533f032f3b05 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.155618 Jan 17 21:21:31.065660 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 79/162] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:30 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:32.083123 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b885e97a-97d4-442b-8cf5-197088b3e558 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:32.083889 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b885e97a-97d4-442b-8cf5-197088b3e558 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:32.090784 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b885e97a-97d4-442b-8cf5-197088b3e558 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:32.091239 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b885e97a-97d4-442b-8cf5-197088b3e558 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:32.092040 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b885e97a-97d4-442b-8cf5-197088b3e558 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:32.092525 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b885e97a-97d4-442b-8cf5-197088b3e558 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:32.236734 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b885e97a-97d4-442b-8cf5-197088b3e558 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:32.244936 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b885e97a-97d4-442b-8cf5-197088b3e558 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.165982 Jan 17 21:21:32.245510 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 84/163] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:32 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:33.261461 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1f01ddfa-5070-45f6-9129-46bf516b740b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:33.262069 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1f01ddfa-5070-45f6-9129-46bf516b740b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:33.267895 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1f01ddfa-5070-45f6-9129-46bf516b740b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:33.268350 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1f01ddfa-5070-45f6-9129-46bf516b740b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:33.269175 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1f01ddfa-5070-45f6-9129-46bf516b740b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:33.269620 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1f01ddfa-5070-45f6-9129-46bf516b740b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:33.400349 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1f01ddfa-5070-45f6-9129-46bf516b740b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:33.408218 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1f01ddfa-5070-45f6-9129-46bf516b740b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.150319 Jan 17 21:21:33.408844 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 80/164] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:33 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:34.425144 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2621fc13-3abc-4793-b77d-8dfe27b4862e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:34.425759 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2621fc13-3abc-4793-b77d-8dfe27b4862e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:34.432231 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2621fc13-3abc-4793-b77d-8dfe27b4862e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:34.432736 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2621fc13-3abc-4793-b77d-8dfe27b4862e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:34.433530 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2621fc13-3abc-4793-b77d-8dfe27b4862e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:34.433976 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2621fc13-3abc-4793-b77d-8dfe27b4862e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:34.566146 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2621fc13-3abc-4793-b77d-8dfe27b4862e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:34.574001 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2621fc13-3abc-4793-b77d-8dfe27b4862e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.152587 Jan 17 21:21:34.574565 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 85/165] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:34 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:35.590111 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a9596983-ed59-4c22-94c5-9b7cfdf8dceb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:35.590711 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a9596983-ed59-4c22-94c5-9b7cfdf8dceb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:35.596614 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a9596983-ed59-4c22-94c5-9b7cfdf8dceb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:35.597009 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a9596983-ed59-4c22-94c5-9b7cfdf8dceb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:35.597807 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a9596983-ed59-4c22-94c5-9b7cfdf8dceb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:35.598246 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a9596983-ed59-4c22-94c5-9b7cfdf8dceb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:35.737825 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a9596983-ed59-4c22-94c5-9b7cfdf8dceb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:35.745610 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a9596983-ed59-4c22-94c5-9b7cfdf8dceb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.159404 Jan 17 21:21:35.746166 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 81/166] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:35 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:36.608966 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1572228879", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452", "networks": [{"uuid": "26db734b-a4bb-4f2a-8d18-dbe8b6a57647"}]}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:21:36.670640 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.network.neutron [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] validate_networks() for [('26db734b-a4bb-4f2a-8d18-dbe8b6a57647', None, None, None, None, None)] {{(pid=116183) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:21:36.761681 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e91ea6e1-1546-4594-b2f2-6bc616473d70 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:36.762285 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e91ea6e1-1546-4594-b2f2-6bc616473d70 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:36.769188 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e91ea6e1-1546-4594-b2f2-6bc616473d70 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:36.769583 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e91ea6e1-1546-4594-b2f2-6bc616473d70 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:36.770407 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e91ea6e1-1546-4594-b2f2-6bc616473d70 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:36.770847 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e91ea6e1-1546-4594-b2f2-6bc616473d70 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:37.064510 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-e91ea6e1-1546-4594-b2f2-6bc616473d70 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:37.075215 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e91ea6e1-1546-4594-b2f2-6bc616473d70 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.315257 Jan 17 21:21:37.075215 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 82/167] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:36 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:21:37.219074 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Flavor limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:21:37.219499 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Image limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:21:37.219973 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Flavor pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:21:37.220447 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Image pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:21:37.221043 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:21:37.230296 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:37.230750 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:37.231682 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:37.232123 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:37.248293 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Getting quotas for project 950cb12ecf9943fa811a11b8a46aeefc. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:21:37.252214 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Getting quotas for user ab0163c5068748eb88921dd43dd762b6 and project 950cb12ecf9943fa811a11b8a46aeefc. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:21:37.264745 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Going to run 1 instances... {{(pid=116183) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:21:37.267307 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:21:37.312102 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-72747abd-e9db-4953-b368-d424d52de010 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706725 Jan 17 21:21:37.316507 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 86/168] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:21:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:21:37.323323 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-52211ee0-5b26-4280-9027-788b8075c3f1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:37.324404 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-52211ee0-5b26-4280-9027-788b8075c3f1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:37.379545 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-52211ee0-5b26-4280-9027-788b8075c3f1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:37.386773 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-52211ee0-5b26-4280-9027-788b8075c3f1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1214 microversion: 2.1 time: 0.067078 Jan 17 21:21:37.387744 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 83/169] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:37 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:38.091173 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-73a7d6c0-8b7d-4111-af5d-7d9cd57b25db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:38.091783 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-73a7d6c0-8b7d-4111-af5d-7d9cd57b25db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:38.100650 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-73a7d6c0-8b7d-4111-af5d-7d9cd57b25db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:38.100650 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-73a7d6c0-8b7d-4111-af5d-7d9cd57b25db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:38.100650 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-73a7d6c0-8b7d-4111-af5d-7d9cd57b25db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:38.100650 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-73a7d6c0-8b7d-4111-af5d-7d9cd57b25db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:38.256972 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-73a7d6c0-8b7d-4111-af5d-7d9cd57b25db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:38.265382 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-73a7d6c0-8b7d-4111-af5d-7d9cd57b25db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.178558 Jan 17 21:21:38.275868 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 87/170] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:38 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:38.403666 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-dfc83812-a4d7-4bcf-9174-bc9ac372bd91 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:38.404649 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-dfc83812-a4d7-4bcf-9174-bc9ac372bd91 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:38.412782 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dfc83812-a4d7-4bcf-9174-bc9ac372bd91 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:38.412782 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dfc83812-a4d7-4bcf-9174-bc9ac372bd91 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:38.412782 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dfc83812-a4d7-4bcf-9174-bc9ac372bd91 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:38.413189 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dfc83812-a4d7-4bcf-9174-bc9ac372bd91 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:38.480182 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-dfc83812-a4d7-4bcf-9174-bc9ac372bd91 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:38.487556 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-dfc83812-a4d7-4bcf-9174-bc9ac372bd91 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1218 microversion: 2.1 time: 0.088332 Jan 17 21:21:38.488518 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 84/171] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:38 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:21:39.282813 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-270c1ac8-0625-464f-97e6-956b894042bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:39.283472 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-270c1ac8-0625-464f-97e6-956b894042bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:39.290272 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-270c1ac8-0625-464f-97e6-956b894042bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:39.290724 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-270c1ac8-0625-464f-97e6-956b894042bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:39.291507 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-270c1ac8-0625-464f-97e6-956b894042bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:39.291951 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-270c1ac8-0625-464f-97e6-956b894042bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:39.422374 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-270c1ac8-0625-464f-97e6-956b894042bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:39.429696 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-270c1ac8-0625-464f-97e6-956b894042bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.150597 Jan 17 21:21:39.430258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 88/172] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:39 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:39.504223 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ec390532-9ce5-42d1-a352-8dc1dc69429f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:39.504859 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ec390532-9ce5-42d1-a352-8dc1dc69429f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:39.515368 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ec390532-9ce5-42d1-a352-8dc1dc69429f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:39.517457 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ec390532-9ce5-42d1-a352-8dc1dc69429f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:39.517457 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ec390532-9ce5-42d1-a352-8dc1dc69429f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:39.517457 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ec390532-9ce5-42d1-a352-8dc1dc69429f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:39.736075 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ec390532-9ce5-42d1-a352-8dc1dc69429f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:39.743785 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ec390532-9ce5-42d1-a352-8dc1dc69429f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1218 microversion: 2.1 time: 0.243158 Jan 17 21:21:39.744350 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 85/173] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:39 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1218 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:40.451539 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f9fc5586-2ff8-4fa9-9c67-8df89db7ceae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:40.453610 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f9fc5586-2ff8-4fa9-9c67-8df89db7ceae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:40.466280 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f9fc5586-2ff8-4fa9-9c67-8df89db7ceae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:40.467116 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f9fc5586-2ff8-4fa9-9c67-8df89db7ceae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:40.468589 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f9fc5586-2ff8-4fa9-9c67-8df89db7ceae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:40.469404 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f9fc5586-2ff8-4fa9-9c67-8df89db7ceae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:40.612447 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-f9fc5586-2ff8-4fa9-9c67-8df89db7ceae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:40.620995 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f9fc5586-2ff8-4fa9-9c67-8df89db7ceae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.177010 Jan 17 21:21:40.621580 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 89/174] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:40 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:40.761967 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5a09a922-169b-4eba-befc-33cee576dff1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:40.762483 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5a09a922-169b-4eba-befc-33cee576dff1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:40.770382 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a09a922-169b-4eba-befc-33cee576dff1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:40.771313 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a09a922-169b-4eba-befc-33cee576dff1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:40.773214 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a09a922-169b-4eba-befc-33cee576dff1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:40.773921 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a09a922-169b-4eba-befc-33cee576dff1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:40.840226 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5a09a922-169b-4eba-befc-33cee576dff1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:40.848149 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5a09a922-169b-4eba-befc-33cee576dff1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1272 microversion: 2.1 time: 0.091073 Jan 17 21:21:40.849478 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 86/175] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:40 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:40.881778 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-094f8e10-6ab3-4a47-a94f-6ad788d65f66 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:40.882272 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-094f8e10-6ab3-4a47-a94f-6ad788d65f66 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:40.888152 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-094f8e10-6ab3-4a47-a94f-6ad788d65f66 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:40.888645 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-094f8e10-6ab3-4a47-a94f-6ad788d65f66 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:40.889430 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-094f8e10-6ab3-4a47-a94f-6ad788d65f66 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:40.889862 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-094f8e10-6ab3-4a47-a94f-6ad788d65f66 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:40.903364 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-094f8e10-6ab3-4a47-a94f-6ad788d65f66 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] HTTP exception thrown: Instance 069fd10f-3002-4910-884d-0bfc2697b631 could not be found. Jan 17 21:21:40.903953 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-094f8e10-6ab3-4a47-a94f-6ad788d65f66 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Returning 404 to user: Instance 069fd10f-3002-4910-884d-0bfc2697b631 could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:21:40.904816 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-094f8e10-6ab3-4a47-a94f-6ad788d65f66 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "DELETE /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 404 len: 111 microversion: 2.1 time: 0.026729 Jan 17 21:21:40.905756 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 90/176] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:21:40 2022] DELETE /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:21:40.914139 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a0bf2211-0092-4c07-b743-a28500f96052 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:40.914760 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a0bf2211-0092-4c07-b743-a28500f96052 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] [instance: 069fd10f-3002-4910-884d-0bfc2697b631] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:40.921042 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a0bf2211-0092-4c07-b743-a28500f96052 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:40.921756 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a0bf2211-0092-4c07-b743-a28500f96052 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:40.922547 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a0bf2211-0092-4c07-b743-a28500f96052 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:40.923006 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a0bf2211-0092-4c07-b743-a28500f96052 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:40.938933 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-a0bf2211-0092-4c07-b743-a28500f96052 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] HTTP exception thrown: Instance 069fd10f-3002-4910-884d-0bfc2697b631 could not be found. Jan 17 21:21:40.940054 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a0bf2211-0092-4c07-b743-a28500f96052 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] Returning 404 to user: Instance 069fd10f-3002-4910-884d-0bfc2697b631 could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:21:40.940937 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a0bf2211-0092-4c07-b743-a28500f96052 tempest-DeleteServersTestJSON-738465300 tempest-DeleteServersTestJSON-738465300-project] 10.222.0.64 "GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631" status: 404 len: 111 microversion: 2.1 time: 0.031331 Jan 17 21:21:40.941553 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 87/177] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:40 2022] GET /compute/v2.1/servers/069fd10f-3002-4910-884d-0bfc2697b631 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:21:41.641001 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6a57c195-ce48-43e3-be27-b746371b57db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:41.641806 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6a57c195-ce48-43e3-be27-b746371b57db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:41.655210 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6a57c195-ce48-43e3-be27-b746371b57db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:41.655939 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6a57c195-ce48-43e3-be27-b746371b57db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:41.656986 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6a57c195-ce48-43e3-be27-b746371b57db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:41.657443 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6a57c195-ce48-43e3-be27-b746371b57db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:41.867310 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-830220ac-07b7-4898-b7e1-2b575f29824d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:41.868211 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-830220ac-07b7-4898-b7e1-2b575f29824d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:41.876689 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-830220ac-07b7-4898-b7e1-2b575f29824d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:41.878243 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-830220ac-07b7-4898-b7e1-2b575f29824d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:41.883810 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-830220ac-07b7-4898-b7e1-2b575f29824d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:41.884499 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-830220ac-07b7-4898-b7e1-2b575f29824d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:41.935335 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6a57c195-ce48-43e3-be27-b746371b57db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:41.947486 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6a57c195-ce48-43e3-be27-b746371b57db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.312235 Jan 17 21:21:41.949026 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 91/178] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:41 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:41.955743 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-69a792ca-2c29-47dc-8932-110f24c1c32f req-502881dd-8516-43bf-b78d-cbe4df7e7ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93682201-3212-40f2-b5b4-972db2013f23", "tag": "dc5936eb-4ad9-44d9-a2fa-30269ec3b2f0"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:21:41.958243 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:21:41.958243 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:21:41.968023 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-69a792ca-2c29-47dc-8932-110f24c1c32f req-502881dd-8516-43bf-b78d-cbe4df7e7ce7 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:41.969151 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-69a792ca-2c29-47dc-8932-110f24c1c32f req-502881dd-8516-43bf-b78d-cbe4df7e7ce7 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:41.996462 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-69a792ca-2c29-47dc-8932-110f24c1c32f req-502881dd-8516-43bf-b78d-cbe4df7e7ce7 service nova] Creating event network-changed:dc5936eb-4ad9-44d9-a2fa-30269ec3b2f0 for instance 93682201-3212-40f2-b5b4-972db2013f23 on hv-cinder-82489 Jan 17 21:21:42.027266 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-69a792ca-2c29-47dc-8932-110f24c1c32f req-502881dd-8516-43bf-b78d-cbe4df7e7ce7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058848 Jan 17 21:21:42.030465 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 92/179] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:21:42.275571 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-830220ac-07b7-4898-b7e1-2b575f29824d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:42.289402 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-830220ac-07b7-4898-b7e1-2b575f29824d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.426210 Jan 17 21:21:42.290556 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 88/180] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:41 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:42.969899 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1064ba56-2c48-492c-be2c-37089b1e98ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:42.971008 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1064ba56-2c48-492c-be2c-37089b1e98ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:42.993523 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1064ba56-2c48-492c-be2c-37089b1e98ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:42.994591 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1064ba56-2c48-492c-be2c-37089b1e98ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:42.996131 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1064ba56-2c48-492c-be2c-37089b1e98ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:42.996976 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1064ba56-2c48-492c-be2c-37089b1e98ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:43.256063 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1064ba56-2c48-492c-be2c-37089b1e98ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:43.269441 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1064ba56-2c48-492c-be2c-37089b1e98ae tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.306328 Jan 17 21:21:43.270364 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 93/181] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:42 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:43.311656 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1c4f2f49-828b-4683-bf9b-bddcefbc71ad tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:43.312329 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1c4f2f49-828b-4683-bf9b-bddcefbc71ad tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:43.323789 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c4f2f49-828b-4683-bf9b-bddcefbc71ad tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:43.324251 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c4f2f49-828b-4683-bf9b-bddcefbc71ad tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:43.325093 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c4f2f49-828b-4683-bf9b-bddcefbc71ad tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:43.326313 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c4f2f49-828b-4683-bf9b-bddcefbc71ad tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:43.559804 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1c4f2f49-828b-4683-bf9b-bddcefbc71ad tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:43.577753 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1c4f2f49-828b-4683-bf9b-bddcefbc71ad tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.272859 Jan 17 21:21:43.578930 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 89/182] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:43 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:44.287510 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-27e4b733-fd95-4538-91b9-835f962ab7da tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:44.288200 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-27e4b733-fd95-4538-91b9-835f962ab7da tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:44.294710 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-27e4b733-fd95-4538-91b9-835f962ab7da tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:44.295244 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-27e4b733-fd95-4538-91b9-835f962ab7da tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:44.296115 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-27e4b733-fd95-4538-91b9-835f962ab7da tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:44.296644 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-27e4b733-fd95-4538-91b9-835f962ab7da tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:44.467477 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-27e4b733-fd95-4538-91b9-835f962ab7da tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:44.476116 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-27e4b733-fd95-4538-91b9-835f962ab7da tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.192922 Jan 17 21:21:44.477778 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 94/183] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:44 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:44.609563 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-68761fb2-4f8c-4d6f-b634-28291aca9f59 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:44.610299 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-68761fb2-4f8c-4d6f-b634-28291aca9f59 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:44.615966 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-68761fb2-4f8c-4d6f-b634-28291aca9f59 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:44.616441 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-68761fb2-4f8c-4d6f-b634-28291aca9f59 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:44.617369 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-68761fb2-4f8c-4d6f-b634-28291aca9f59 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:44.617648 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-68761fb2-4f8c-4d6f-b634-28291aca9f59 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:44.672283 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-427610882", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452", "networks": [{"uuid": "90270886-8b72-4996-b451-52316e1bfe26"}]}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:21:44.741861 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.network.neutron [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] validate_networks() for [('90270886-8b72-4996-b451-52316e1bfe26', None, None, None, None, None)] {{(pid=116182) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:21:44.816180 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-68761fb2-4f8c-4d6f-b634-28291aca9f59 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:44.823410 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-68761fb2-4f8c-4d6f-b634-28291aca9f59 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.217389 Jan 17 21:21:44.823984 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 95/184] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:44 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:21:45.095308 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Flavor limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:21:45.095732 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Image limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:21:45.096215 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Flavor pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:21:45.096751 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Image pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:21:45.097110 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:21:45.107393 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:45.107844 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:45.108700 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:45.109142 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:45.125916 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Getting quotas for project 28496391913444ba9a1f04ca404c2c68. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:21:45.129852 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Getting quotas for user 5cfa3e62e8f64305a304058e9704ef23 and project 28496391913444ba9a1f04ca404c2c68. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:21:45.141499 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Going to run 1 instances... {{(pid=116182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:21:45.143804 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:21:45.189731 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-dcabf763-5c32-43e9-839f-a691673e9d57 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635018 Jan 17 21:21:45.190368 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 90/185] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:21:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:21:45.200546 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-419c5579-daa1-4629-8259-fcbc0736811f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:45.201237 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-419c5579-daa1-4629-8259-fcbc0736811f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:45.251762 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-419c5579-daa1-4629-8259-fcbc0736811f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:45.258874 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-419c5579-daa1-4629-8259-fcbc0736811f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1217 microversion: 2.1 time: 0.061894 Jan 17 21:21:45.259437 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 96/186] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:45 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1217 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:45.492726 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-cb8a47e0-c0b4-4f8f-8226-cc154f58c3bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:45.493340 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-cb8a47e0-c0b4-4f8f-8226-cc154f58c3bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:45.499492 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cb8a47e0-c0b4-4f8f-8226-cc154f58c3bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:45.500115 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cb8a47e0-c0b4-4f8f-8226-cc154f58c3bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:45.500949 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cb8a47e0-c0b4-4f8f-8226-cc154f58c3bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:45.501872 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cb8a47e0-c0b4-4f8f-8226-cc154f58c3bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:45.631613 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-cb8a47e0-c0b4-4f8f-8226-cc154f58c3bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:45.638943 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-cb8a47e0-c0b4-4f8f-8226-cc154f58c3bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.150410 Jan 17 21:21:45.639431 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 91/187] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:45 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:45.840201 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-efcee65f-9fc5-4e25-8523-9df382b9a312 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:45.840845 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-efcee65f-9fc5-4e25-8523-9df382b9a312 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:45.847384 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-efcee65f-9fc5-4e25-8523-9df382b9a312 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:45.847839 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-efcee65f-9fc5-4e25-8523-9df382b9a312 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:45.848669 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-efcee65f-9fc5-4e25-8523-9df382b9a312 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:45.849679 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-efcee65f-9fc5-4e25-8523-9df382b9a312 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:45.983625 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-efcee65f-9fc5-4e25-8523-9df382b9a312 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:45.992269 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-efcee65f-9fc5-4e25-8523-9df382b9a312 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.155829 Jan 17 21:21:45.992880 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 97/188] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:45 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:46.275454 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-db2aa35f-1fd2-4212-8f1b-0fb705d5e1b9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:46.276060 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-db2aa35f-1fd2-4212-8f1b-0fb705d5e1b9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:46.281941 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-db2aa35f-1fd2-4212-8f1b-0fb705d5e1b9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:46.282389 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-db2aa35f-1fd2-4212-8f1b-0fb705d5e1b9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:46.283157 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-db2aa35f-1fd2-4212-8f1b-0fb705d5e1b9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:46.283593 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-db2aa35f-1fd2-4212-8f1b-0fb705d5e1b9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:46.343892 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-db2aa35f-1fd2-4212-8f1b-0fb705d5e1b9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:46.351453 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-db2aa35f-1fd2-4212-8f1b-0fb705d5e1b9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1221 microversion: 2.1 time: 0.079662 Jan 17 21:21:46.352026 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 92/189] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:46 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:46.655975 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-478c6f1c-09ac-4c3e-bb79-17afe8ec63c0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:46.656612 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-478c6f1c-09ac-4c3e-bb79-17afe8ec63c0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:46.662989 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-478c6f1c-09ac-4c3e-bb79-17afe8ec63c0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:46.663441 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-478c6f1c-09ac-4c3e-bb79-17afe8ec63c0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:46.664252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-478c6f1c-09ac-4c3e-bb79-17afe8ec63c0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:46.664717 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-478c6f1c-09ac-4c3e-bb79-17afe8ec63c0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:46.796491 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-478c6f1c-09ac-4c3e-bb79-17afe8ec63c0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:46.804656 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-478c6f1c-09ac-4c3e-bb79-17afe8ec63c0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.152263 Jan 17 21:21:46.805315 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 98/190] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:46 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:47.009508 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-57c01ab3-f59e-494b-ad0e-e5ae6c797896 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:47.010052 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-57c01ab3-f59e-494b-ad0e-e5ae6c797896 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:47.015862 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-57c01ab3-f59e-494b-ad0e-e5ae6c797896 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:47.016313 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-57c01ab3-f59e-494b-ad0e-e5ae6c797896 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:47.017122 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-57c01ab3-f59e-494b-ad0e-e5ae6c797896 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:47.017563 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-57c01ab3-f59e-494b-ad0e-e5ae6c797896 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:47.281395 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-57c01ab3-f59e-494b-ad0e-e5ae6c797896 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:47.289045 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-57c01ab3-f59e-494b-ad0e-e5ae6c797896 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.283827 Jan 17 21:21:47.289627 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 93/191] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:47 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:47.367670 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c98b1a7f-4008-41af-bca9-8d956b920b6e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:47.368271 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c98b1a7f-4008-41af-bca9-8d956b920b6e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:47.374460 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c98b1a7f-4008-41af-bca9-8d956b920b6e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:47.374908 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c98b1a7f-4008-41af-bca9-8d956b920b6e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:47.375672 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c98b1a7f-4008-41af-bca9-8d956b920b6e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:47.376103 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c98b1a7f-4008-41af-bca9-8d956b920b6e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:47.434002 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-c98b1a7f-4008-41af-bca9-8d956b920b6e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:47.441214 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c98b1a7f-4008-41af-bca9-8d956b920b6e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1213 microversion: 2.1 time: 0.077162 Jan 17 21:21:47.441785 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 99/192] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:47 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:47.821799 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0c9a15ff-e370-4d41-9a4e-4fb397ec060f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:47.822429 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0c9a15ff-e370-4d41-9a4e-4fb397ec060f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:47.828805 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0c9a15ff-e370-4d41-9a4e-4fb397ec060f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:47.829255 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0c9a15ff-e370-4d41-9a4e-4fb397ec060f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:47.830040 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0c9a15ff-e370-4d41-9a4e-4fb397ec060f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:47.830475 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0c9a15ff-e370-4d41-9a4e-4fb397ec060f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:47.959027 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-0c9a15ff-e370-4d41-9a4e-4fb397ec060f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:47.968599 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0c9a15ff-e370-4d41-9a4e-4fb397ec060f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.150912 Jan 17 21:21:47.969190 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 94/193] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:47 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:48.305713 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c32b5cbe-e7a3-4077-a3a2-13eb3d9a16c1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:48.306355 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c32b5cbe-e7a3-4077-a3a2-13eb3d9a16c1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:48.312190 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c32b5cbe-e7a3-4077-a3a2-13eb3d9a16c1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:48.312669 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c32b5cbe-e7a3-4077-a3a2-13eb3d9a16c1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:48.313435 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c32b5cbe-e7a3-4077-a3a2-13eb3d9a16c1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:48.313867 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c32b5cbe-e7a3-4077-a3a2-13eb3d9a16c1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:48.443675 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-c32b5cbe-e7a3-4077-a3a2-13eb3d9a16c1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:48.450768 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c32b5cbe-e7a3-4077-a3a2-13eb3d9a16c1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.148831 Jan 17 21:21:48.451321 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 100/194] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:48 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:48.458845 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5dd8af59-be1f-4b9a-b6a4-0d3f3f0efd3d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:48.459456 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5dd8af59-be1f-4b9a-b6a4-0d3f3f0efd3d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:48.465584 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5dd8af59-be1f-4b9a-b6a4-0d3f3f0efd3d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:48.466035 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5dd8af59-be1f-4b9a-b6a4-0d3f3f0efd3d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:48.466981 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5dd8af59-be1f-4b9a-b6a4-0d3f3f0efd3d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:48.467421 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5dd8af59-be1f-4b9a-b6a4-0d3f3f0efd3d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:48.529491 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5dd8af59-be1f-4b9a-b6a4-0d3f3f0efd3d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:48.537876 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5dd8af59-be1f-4b9a-b6a4-0d3f3f0efd3d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1213 microversion: 2.1 time: 0.083082 Jan 17 21:21:48.538410 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 95/195] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:48 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:48.986522 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-85545632-a59e-45ec-8650-37a748a6a4b6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:48.987213 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-85545632-a59e-45ec-8650-37a748a6a4b6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:48.993319 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-85545632-a59e-45ec-8650-37a748a6a4b6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:48.993771 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-85545632-a59e-45ec-8650-37a748a6a4b6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:48.994558 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-85545632-a59e-45ec-8650-37a748a6a4b6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:48.994995 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-85545632-a59e-45ec-8650-37a748a6a4b6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:49.124795 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-85545632-a59e-45ec-8650-37a748a6a4b6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:49.134842 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-85545632-a59e-45ec-8650-37a748a6a4b6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1522 microversion: 2.1 time: 0.151802 Jan 17 21:21:49.135477 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 101/196] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:48 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:49.468203 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ff5959aa-a814-4ccf-824d-62f52135b51c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:49.468906 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ff5959aa-a814-4ccf-824d-62f52135b51c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:49.475176 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ff5959aa-a814-4ccf-824d-62f52135b51c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:49.475691 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ff5959aa-a814-4ccf-824d-62f52135b51c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:49.476688 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ff5959aa-a814-4ccf-824d-62f52135b51c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:49.477293 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ff5959aa-a814-4ccf-824d-62f52135b51c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:49.555009 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-eabb36aa-2eb5-4ac3-8b92-1fd32be7e515 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:49.556515 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-eabb36aa-2eb5-4ac3-8b92-1fd32be7e515 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:49.565650 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eabb36aa-2eb5-4ac3-8b92-1fd32be7e515 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:49.566219 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eabb36aa-2eb5-4ac3-8b92-1fd32be7e515 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:49.567176 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eabb36aa-2eb5-4ac3-8b92-1fd32be7e515 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:49.568258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eabb36aa-2eb5-4ac3-8b92-1fd32be7e515 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:49.653767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ff5959aa-a814-4ccf-824d-62f52135b51c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:49.662783 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ff5959aa-a814-4ccf-824d-62f52135b51c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.198381 Jan 17 21:21:49.663341 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 96/197] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:49 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:49.710096 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-eabb36aa-2eb5-4ac3-8b92-1fd32be7e515 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:49.719164 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-eabb36aa-2eb5-4ac3-8b92-1fd32be7e515 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1275 microversion: 2.1 time: 0.168229 Jan 17 21:21:49.720251 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 102/198] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:49 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:21:50.154942 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-41902ed0-21ec-47af-bd93-7a492f220bc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:50.155554 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-41902ed0-21ec-47af-bd93-7a492f220bc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:50.162088 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41902ed0-21ec-47af-bd93-7a492f220bc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:50.162550 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41902ed0-21ec-47af-bd93-7a492f220bc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:50.163325 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41902ed0-21ec-47af-bd93-7a492f220bc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:50.163767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41902ed0-21ec-47af-bd93-7a492f220bc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:50.305872 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-41902ed0-21ec-47af-bd93-7a492f220bc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:50.313941 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-41902ed0-21ec-47af-bd93-7a492f220bc3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1502 microversion: 2.1 time: 0.162783 Jan 17 21:21:50.314499 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 97/199] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:50 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:50.330138 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0f2a5916-f682-494b-aac8-b5346fcd94fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:50.330743 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-0f2a5916-f682-494b-aac8-b5346fcd94fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:50.336591 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0f2a5916-f682-494b-aac8-b5346fcd94fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:50.337023 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0f2a5916-f682-494b-aac8-b5346fcd94fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:50.337789 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0f2a5916-f682-494b-aac8-b5346fcd94fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:50.338220 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0f2a5916-f682-494b-aac8-b5346fcd94fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:50.467291 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-0f2a5916-f682-494b-aac8-b5346fcd94fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:50.475032 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-0f2a5916-f682-494b-aac8-b5346fcd94fa tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1514 microversion: 2.1 time: 0.148530 Jan 17 21:21:50.475597 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 103/200] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:50 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:50.679679 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-131987e0-6404-4daf-8526-3ffe37b597d2 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:50.680330 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-131987e0-6404-4daf-8526-3ffe37b597d2 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:50.686465 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-131987e0-6404-4daf-8526-3ffe37b597d2 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:50.687053 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-131987e0-6404-4daf-8526-3ffe37b597d2 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:50.687838 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-131987e0-6404-4daf-8526-3ffe37b597d2 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:50.690066 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-131987e0-6404-4daf-8526-3ffe37b597d2 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:50.736214 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ce54019f-5619-4690-8b92-1f36c85c48a5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:50.737308 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ce54019f-5619-4690-8b92-1f36c85c48a5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:50.753124 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ce54019f-5619-4690-8b92-1f36c85c48a5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:50.753735 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ce54019f-5619-4690-8b92-1f36c85c48a5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:50.754588 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ce54019f-5619-4690-8b92-1f36c85c48a5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:50.755982 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ce54019f-5619-4690-8b92-1f36c85c48a5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:50.938034 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-131987e0-6404-4daf-8526-3ffe37b597d2 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:50.942575 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ce54019f-5619-4690-8b92-1f36c85c48a5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:50.945341 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-131987e0-6404-4daf-8526-3ffe37b597d2 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.269508 Jan 17 21:21:50.945909 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 98/201] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:50 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:50.950027 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ce54019f-5619-4690-8b92-1f36c85c48a5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.217545 Jan 17 21:21:50.951624 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 104/202] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:50 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:51.961956 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-066ec74d-9f52-4468-8697-8df2ffcd383d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:51.962586 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-066ec74d-9f52-4468-8697-8df2ffcd383d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:51.968885 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-066ec74d-9f52-4468-8697-8df2ffcd383d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:51.969338 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-066ec74d-9f52-4468-8697-8df2ffcd383d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:51.970129 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-066ec74d-9f52-4468-8697-8df2ffcd383d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:51.970337 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-39107bb9-427a-4634-be1f-04626abc003a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:51.970741 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-066ec74d-9f52-4468-8697-8df2ffcd383d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:51.970952 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-39107bb9-427a-4634-be1f-04626abc003a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:51.977701 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-39107bb9-427a-4634-be1f-04626abc003a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:51.978151 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-39107bb9-427a-4634-be1f-04626abc003a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:51.978937 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-39107bb9-427a-4634-be1f-04626abc003a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:51.979379 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-39107bb9-427a-4634-be1f-04626abc003a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:52.168017 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-39107bb9-427a-4634-be1f-04626abc003a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:52.175292 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-066ec74d-9f52-4468-8697-8df2ffcd383d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:52.175433 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-39107bb9-427a-4634-be1f-04626abc003a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.211188 Jan 17 21:21:52.176081 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 105/203] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:51 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:52.183253 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-066ec74d-9f52-4468-8697-8df2ffcd383d tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.224933 Jan 17 21:21:52.183840 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 99/204] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:51 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:53.193494 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1653a85b-d340-4570-afdd-5742c2378782 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:53.194227 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1653a85b-d340-4570-afdd-5742c2378782 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:53.199905 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ca6de3b4-ac50-42ef-9cd4-13470b205b19 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:53.201258 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ca6de3b4-ac50-42ef-9cd4-13470b205b19 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:53.205541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1653a85b-d340-4570-afdd-5742c2378782 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:53.206237 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1653a85b-d340-4570-afdd-5742c2378782 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:53.207032 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca6de3b4-ac50-42ef-9cd4-13470b205b19 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:53.207472 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1653a85b-d340-4570-afdd-5742c2378782 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:53.207590 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca6de3b4-ac50-42ef-9cd4-13470b205b19 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:53.208774 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1653a85b-d340-4570-afdd-5742c2378782 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:53.209007 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca6de3b4-ac50-42ef-9cd4-13470b205b19 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:53.209447 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca6de3b4-ac50-42ef-9cd4-13470b205b19 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:53.404992 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ca6de3b4-ac50-42ef-9cd4-13470b205b19 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:53.412680 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1653a85b-d340-4570-afdd-5742c2378782 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:53.412845 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ca6de3b4-ac50-42ef-9cd4-13470b205b19 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.216829 Jan 17 21:21:53.413428 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 100/205] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:53 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:21:53.417825 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-bb45da2a-1ede-4b03-b73f-6cde7e977e64 req-864d8163-3cd4-428d-912e-4d9043f4ebbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de27f69-552a-4922-8576-4163c4c8bfb0", "tag": "0371bc2b-703b-41a8-b868-151139132091"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:21:53.419381 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:21:53.419381 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:21:53.420406 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1653a85b-d340-4570-afdd-5742c2378782 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.231492 Jan 17 21:21:53.421049 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 106/206] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:53 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:53.426022 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-bb45da2a-1ede-4b03-b73f-6cde7e977e64 req-864d8163-3cd4-428d-912e-4d9043f4ebbd service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:53.426475 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-bb45da2a-1ede-4b03-b73f-6cde7e977e64 req-864d8163-3cd4-428d-912e-4d9043f4ebbd service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:53.437527 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-bb45da2a-1ede-4b03-b73f-6cde7e977e64 req-864d8163-3cd4-428d-912e-4d9043f4ebbd service nova] Creating event network-changed:0371bc2b-703b-41a8-b868-151139132091 for instance 3de27f69-552a-4922-8576-4163c4c8bfb0 on hv-cinder-82489 Jan 17 21:21:53.442414 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-bb45da2a-1ede-4b03-b73f-6cde7e977e64 req-864d8163-3cd4-428d-912e-4d9043f4ebbd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027813 Jan 17 21:21:53.442982 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 101/207] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:21:54.428655 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-16b86a3a-86b3-4d7c-b33f-edaae1f25ff6 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:54.429229 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-16b86a3a-86b3-4d7c-b33f-edaae1f25ff6 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:54.435762 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-16b86a3a-86b3-4d7c-b33f-edaae1f25ff6 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:54.436212 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-16b86a3a-86b3-4d7c-b33f-edaae1f25ff6 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:54.437040 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-16b86a3a-86b3-4d7c-b33f-edaae1f25ff6 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:54.437471 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-16b86a3a-86b3-4d7c-b33f-edaae1f25ff6 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:54.437770 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-04f9a253-5f6d-48c5-bcf9-852196ba236d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:54.438466 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-04f9a253-5f6d-48c5-bcf9-852196ba236d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:54.445049 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-04f9a253-5f6d-48c5-bcf9-852196ba236d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:54.445502 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-04f9a253-5f6d-48c5-bcf9-852196ba236d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:54.446315 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-04f9a253-5f6d-48c5-bcf9-852196ba236d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:54.446753 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-04f9a253-5f6d-48c5-bcf9-852196ba236d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:54.637114 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-16b86a3a-86b3-4d7c-b33f-edaae1f25ff6 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:54.640013 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-04f9a253-5f6d-48c5-bcf9-852196ba236d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:54.644669 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-16b86a3a-86b3-4d7c-b33f-edaae1f25ff6 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.219675 Jan 17 21:21:54.645363 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 107/208] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:54 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:54.647583 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-04f9a253-5f6d-48c5-bcf9-852196ba236d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.213702 Jan 17 21:21:54.648125 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 102/209] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:54 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:21:55.661906 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-286fc2e0-ee26-42a2-9dfc-811b8c054a84 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:55.662569 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-286fc2e0-ee26-42a2-9dfc-811b8c054a84 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:55.664463 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-221cadc8-a286-4ba9-be82-56cefee68f29 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:55.665071 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-221cadc8-a286-4ba9-be82-56cefee68f29 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:55.669356 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-286fc2e0-ee26-42a2-9dfc-811b8c054a84 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:55.669745 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-286fc2e0-ee26-42a2-9dfc-811b8c054a84 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:55.670541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-286fc2e0-ee26-42a2-9dfc-811b8c054a84 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:55.670874 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-221cadc8-a286-4ba9-be82-56cefee68f29 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:55.670981 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-286fc2e0-ee26-42a2-9dfc-811b8c054a84 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:55.671335 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-221cadc8-a286-4ba9-be82-56cefee68f29 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:55.672115 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-221cadc8-a286-4ba9-be82-56cefee68f29 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:55.672579 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-221cadc8-a286-4ba9-be82-56cefee68f29 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:55.868454 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-286fc2e0-ee26-42a2-9dfc-811b8c054a84 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:55.872064 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-221cadc8-a286-4ba9-be82-56cefee68f29 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:55.876885 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-286fc2e0-ee26-42a2-9dfc-811b8c054a84 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.219099 Jan 17 21:21:55.877470 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 108/210] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:55 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:55.882105 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-221cadc8-a286-4ba9-be82-56cefee68f29 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.221581 Jan 17 21:21:55.882774 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 103/211] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:55 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:56.895826 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-44d30d65-b112-4b51-80f8-0120a151f27f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:56.896470 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-44d30d65-b112-4b51-80f8-0120a151f27f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:56.898634 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6f500d16-0046-4fd4-8adf-d1f1437575b3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:56.899310 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6f500d16-0046-4fd4-8adf-d1f1437575b3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:56.902915 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-44d30d65-b112-4b51-80f8-0120a151f27f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:56.903378 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-44d30d65-b112-4b51-80f8-0120a151f27f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:56.904167 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-44d30d65-b112-4b51-80f8-0120a151f27f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:56.904638 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-44d30d65-b112-4b51-80f8-0120a151f27f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:56.905227 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6f500d16-0046-4fd4-8adf-d1f1437575b3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:56.905608 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6f500d16-0046-4fd4-8adf-d1f1437575b3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:56.906378 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6f500d16-0046-4fd4-8adf-d1f1437575b3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:56.906803 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6f500d16-0046-4fd4-8adf-d1f1437575b3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:57.136123 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6f500d16-0046-4fd4-8adf-d1f1437575b3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:57.141567 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-44d30d65-b112-4b51-80f8-0120a151f27f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:57.147702 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6f500d16-0046-4fd4-8adf-d1f1437575b3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.252087 Jan 17 21:21:57.148283 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 104/212] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:56 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:21:57.152489 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-44d30d65-b112-4b51-80f8-0120a151f27f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.260440 Jan 17 21:21:57.153123 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 109/213] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:56 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:58.180545 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c39e6eab-533a-4717-b2de-470185322a2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:58.181953 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c39e6eab-533a-4717-b2de-470185322a2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:58.188120 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f826a954-a757-48e8-929b-657b5894f4ce tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:58.189506 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f826a954-a757-48e8-929b-657b5894f4ce tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:58.196679 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c39e6eab-533a-4717-b2de-470185322a2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:58.197861 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c39e6eab-533a-4717-b2de-470185322a2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:58.198902 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c39e6eab-533a-4717-b2de-470185322a2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:58.199495 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c39e6eab-533a-4717-b2de-470185322a2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:58.209936 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f826a954-a757-48e8-929b-657b5894f4ce tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:58.210617 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f826a954-a757-48e8-929b-657b5894f4ce tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:58.211836 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f826a954-a757-48e8-929b-657b5894f4ce tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:58.212362 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f826a954-a757-48e8-929b-657b5894f4ce tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:58.446765 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c39e6eab-533a-4717-b2de-470185322a2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:58.456106 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c39e6eab-533a-4717-b2de-470185322a2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.294321 Jan 17 21:21:58.456714 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 105/214] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:58 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:58.467237 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-26f89915-1d6b-472f-90f4-beab82fb9264 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:21:58.468325 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-26f89915-1d6b-472f-90f4-beab82fb9264 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:58.473246 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-f826a954-a757-48e8-929b-657b5894f4ce tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:58.479995 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-26f89915-1d6b-472f-90f4-beab82fb9264 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:58.480657 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-26f89915-1d6b-472f-90f4-beab82fb9264 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:58.481465 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-26f89915-1d6b-472f-90f4-beab82fb9264 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:58.481924 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-26f89915-1d6b-472f-90f4-beab82fb9264 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:58.482808 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f826a954-a757-48e8-929b-657b5894f4ce tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.304014 Jan 17 21:21:58.483859 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 110/215] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:58 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:58.521876 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-26f89915-1d6b-472f-90f4-beab82fb9264 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lazy-loading 'flavor' on Instance uuid 8a5818e4-0026-4597-9ef3-d539c2cdee97 {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:21:58.663110 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-26f89915-1d6b-472f-90f4-beab82fb9264 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "POST /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/action" status: 200 len: 32 microversion: 2.1 time: 0.203191 Jan 17 21:21:58.664010 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 106/216] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:21:58 2022] POST /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/action => generated 32 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:21:58.675013 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e001bb4b-e199-4c00-896d-3e7022021244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:58.675941 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-e001bb4b-e199-4c00-896d-3e7022021244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:58.700313 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e001bb4b-e199-4c00-896d-3e7022021244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:58.700991 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e001bb4b-e199-4c00-896d-3e7022021244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:58.701999 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e001bb4b-e199-4c00-896d-3e7022021244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:58.702560 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e001bb4b-e199-4c00-896d-3e7022021244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:58.909379 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-e001bb4b-e199-4c00-896d-3e7022021244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:58.917511 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e001bb4b-e199-4c00-896d-3e7022021244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.248154 Jan 17 21:21:58.918082 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 111/217] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:58 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:59.473532 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-99cbfad1-00fc-47c7-a221-a567269c7ce7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:59.474707 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-99cbfad1-00fc-47c7-a221-a567269c7ce7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:59.481001 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99cbfad1-00fc-47c7-a221-a567269c7ce7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:59.481448 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99cbfad1-00fc-47c7-a221-a567269c7ce7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:59.482231 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99cbfad1-00fc-47c7-a221-a567269c7ce7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:59.482669 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99cbfad1-00fc-47c7-a221-a567269c7ce7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:59.501551 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c2a0758c-659e-4d60-9d90-f123693ca584 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:59.502225 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c2a0758c-659e-4d60-9d90-f123693ca584 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:59.508564 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c2a0758c-659e-4d60-9d90-f123693ca584 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:59.509021 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c2a0758c-659e-4d60-9d90-f123693ca584 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:59.509812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c2a0758c-659e-4d60-9d90-f123693ca584 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:59.510254 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c2a0758c-659e-4d60-9d90-f123693ca584 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:59.666907 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-99cbfad1-00fc-47c7-a221-a567269c7ce7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:59.674173 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-99cbfad1-00fc-47c7-a221-a567269c7ce7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.204687 Jan 17 21:21:59.674740 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 107/218] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:59 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:21:59.687404 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-c2a0758c-659e-4d60-9d90-f123693ca584 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:21:59.694590 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c2a0758c-659e-4d60-9d90-f123693ca584 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.196601 Jan 17 21:21:59.695145 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 112/219] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:59 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:21:59.934245 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-307a471b-8f3f-4327-bad0-ed9fc0d4954c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:21:59.934920 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-307a471b-8f3f-4327-bad0-ed9fc0d4954c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:21:59.940811 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-307a471b-8f3f-4327-bad0-ed9fc0d4954c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:59.941268 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-307a471b-8f3f-4327-bad0-ed9fc0d4954c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:21:59.942052 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-307a471b-8f3f-4327-bad0-ed9fc0d4954c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:21:59.942489 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-307a471b-8f3f-4327-bad0-ed9fc0d4954c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:00.071316 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-307a471b-8f3f-4327-bad0-ed9fc0d4954c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:00.078620 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-307a471b-8f3f-4327-bad0-ed9fc0d4954c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.147966 Jan 17 21:22:00.079179 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 108/220] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:21:59 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:00.691092 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9f321656-1f96-4030-bc78-030ab3f46f81 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:00.691773 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-9f321656-1f96-4030-bc78-030ab3f46f81 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:00.697974 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9f321656-1f96-4030-bc78-030ab3f46f81 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:00.698419 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9f321656-1f96-4030-bc78-030ab3f46f81 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:00.699184 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9f321656-1f96-4030-bc78-030ab3f46f81 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:00.699617 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9f321656-1f96-4030-bc78-030ab3f46f81 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:00.711158 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d6b9de11-4593-4efc-978b-691589710630 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:00.711803 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d6b9de11-4593-4efc-978b-691589710630 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:00.717937 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d6b9de11-4593-4efc-978b-691589710630 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:00.718396 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d6b9de11-4593-4efc-978b-691589710630 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:00.719194 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d6b9de11-4593-4efc-978b-691589710630 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:00.719623 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d6b9de11-4593-4efc-978b-691589710630 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:00.898214 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-9f321656-1f96-4030-bc78-030ab3f46f81 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:00.901592 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d6b9de11-4593-4efc-978b-691589710630 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:00.905811 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-9f321656-1f96-4030-bc78-030ab3f46f81 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.218283 Jan 17 21:22:00.906499 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 113/221] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:00 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:00.908750 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d6b9de11-4593-4efc-978b-691589710630 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.201608 Jan 17 21:22:00.909293 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 109/222] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:00 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:01.096660 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d113e9b7-cdfe-4424-9487-7eeb32da4331 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:01.097199 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d113e9b7-cdfe-4424-9487-7eeb32da4331 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:01.103062 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d113e9b7-cdfe-4424-9487-7eeb32da4331 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:01.103520 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d113e9b7-cdfe-4424-9487-7eeb32da4331 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:01.104302 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d113e9b7-cdfe-4424-9487-7eeb32da4331 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:01.104777 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d113e9b7-cdfe-4424-9487-7eeb32da4331 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:01.239436 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-d113e9b7-cdfe-4424-9487-7eeb32da4331 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:01.247166 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d113e9b7-cdfe-4424-9487-7eeb32da4331 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.154360 Jan 17 21:22:01.247731 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 114/223] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:01 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:01.923618 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-65fe5b3c-4bd0-4183-832b-f52c17d329cc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:01.924359 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-65fe5b3c-4bd0-4183-832b-f52c17d329cc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:01.925725 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-19a1ba47-f06f-4b83-a516-7f37e0a90752 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:01.926397 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-19a1ba47-f06f-4b83-a516-7f37e0a90752 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:01.931150 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-65fe5b3c-4bd0-4183-832b-f52c17d329cc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:01.931682 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-65fe5b3c-4bd0-4183-832b-f52c17d329cc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:01.932574 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-65fe5b3c-4bd0-4183-832b-f52c17d329cc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:01.933085 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-65fe5b3c-4bd0-4183-832b-f52c17d329cc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:01.933177 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-19a1ba47-f06f-4b83-a516-7f37e0a90752 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:01.933542 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-19a1ba47-f06f-4b83-a516-7f37e0a90752 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:01.934344 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-19a1ba47-f06f-4b83-a516-7f37e0a90752 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:01.934768 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-19a1ba47-f06f-4b83-a516-7f37e0a90752 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:02.125805 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-19a1ba47-f06f-4b83-a516-7f37e0a90752 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:02.130406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-65fe5b3c-4bd0-4183-832b-f52c17d329cc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:02.133811 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-19a1ba47-f06f-4b83-a516-7f37e0a90752 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.211641 Jan 17 21:22:02.134334 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 115/224] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:01 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:02.138676 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-65fe5b3c-4bd0-4183-832b-f52c17d329cc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.219514 Jan 17 21:22:02.139360 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 110/225] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:01 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:02.264489 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1f991eda-a92c-4d62-9a23-c6abb9793826 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:02.264918 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1f991eda-a92c-4d62-9a23-c6abb9793826 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:02.271779 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1f991eda-a92c-4d62-9a23-c6abb9793826 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:02.271978 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1f991eda-a92c-4d62-9a23-c6abb9793826 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:02.272794 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1f991eda-a92c-4d62-9a23-c6abb9793826 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:02.273235 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1f991eda-a92c-4d62-9a23-c6abb9793826 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:02.570124 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1f991eda-a92c-4d62-9a23-c6abb9793826 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:02.577509 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1f991eda-a92c-4d62-9a23-c6abb9793826 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.316884 Jan 17 21:22:02.578079 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 116/226] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:02 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:03.150489 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-bbb297b7-8831-4dab-9ea0-c0294a042c75 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:03.151081 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-bbb297b7-8831-4dab-9ea0-c0294a042c75 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:03.154955 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b9a523cc-599b-4204-a206-94f8e2b548d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:03.155572 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b9a523cc-599b-4204-a206-94f8e2b548d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:03.157358 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bbb297b7-8831-4dab-9ea0-c0294a042c75 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:03.157812 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bbb297b7-8831-4dab-9ea0-c0294a042c75 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:03.158597 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bbb297b7-8831-4dab-9ea0-c0294a042c75 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:03.159033 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bbb297b7-8831-4dab-9ea0-c0294a042c75 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:03.162080 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b9a523cc-599b-4204-a206-94f8e2b548d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:03.162594 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b9a523cc-599b-4204-a206-94f8e2b548d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:03.163348 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b9a523cc-599b-4204-a206-94f8e2b548d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:03.163783 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b9a523cc-599b-4204-a206-94f8e2b548d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:03.354377 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-bbb297b7-8831-4dab-9ea0-c0294a042c75 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:03.358622 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b9a523cc-599b-4204-a206-94f8e2b548d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:03.361799 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-bbb297b7-8831-4dab-9ea0-c0294a042c75 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.214947 Jan 17 21:22:03.362366 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 111/227] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:03 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:03.367594 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b9a523cc-599b-4204-a206-94f8e2b548d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.216348 Jan 17 21:22:03.368359 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 117/228] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:03 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:03.594957 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-830272f7-7c78-40e2-9bb6-f1b4b5638877 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:03.595562 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-830272f7-7c78-40e2-9bb6-f1b4b5638877 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:03.602433 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-830272f7-7c78-40e2-9bb6-f1b4b5638877 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:03.602882 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-830272f7-7c78-40e2-9bb6-f1b4b5638877 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:03.603671 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-830272f7-7c78-40e2-9bb6-f1b4b5638877 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:03.604110 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-830272f7-7c78-40e2-9bb6-f1b4b5638877 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:03.742054 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-830272f7-7c78-40e2-9bb6-f1b4b5638877 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:03.749476 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-830272f7-7c78-40e2-9bb6-f1b4b5638877 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.158273 Jan 17 21:22:03.750037 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 112/229] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:03 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:04.380073 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-15858fab-98d4-440e-84a2-70f3e76a1a52 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:04.381712 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-15858fab-98d4-440e-84a2-70f3e76a1a52 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:04.388289 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1c89799c-34d1-4779-adbb-b3b6a39ca6d6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:04.388981 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1c89799c-34d1-4779-adbb-b3b6a39ca6d6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:04.390468 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-15858fab-98d4-440e-84a2-70f3e76a1a52 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:04.390949 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-15858fab-98d4-440e-84a2-70f3e76a1a52 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:04.392464 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-15858fab-98d4-440e-84a2-70f3e76a1a52 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:04.392591 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-15858fab-98d4-440e-84a2-70f3e76a1a52 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:04.399103 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c89799c-34d1-4779-adbb-b3b6a39ca6d6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:04.399552 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c89799c-34d1-4779-adbb-b3b6a39ca6d6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:04.400336 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c89799c-34d1-4779-adbb-b3b6a39ca6d6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:04.400793 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c89799c-34d1-4779-adbb-b3b6a39ca6d6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:04.599852 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-15858fab-98d4-440e-84a2-70f3e76a1a52 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:04.604144 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1c89799c-34d1-4779-adbb-b3b6a39ca6d6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:04.607514 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-15858fab-98d4-440e-84a2-70f3e76a1a52 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.232127 Jan 17 21:22:04.608216 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 118/230] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:04 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:04.611515 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1c89799c-34d1-4779-adbb-b3b6a39ca6d6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.227778 Jan 17 21:22:04.612069 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 113/231] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:04 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:04.766555 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-24a499ec-53bf-434d-b9f1-a60671d48815 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:04.767073 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-24a499ec-53bf-434d-b9f1-a60671d48815 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:04.773668 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24a499ec-53bf-434d-b9f1-a60671d48815 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:04.774149 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24a499ec-53bf-434d-b9f1-a60671d48815 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:04.774928 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24a499ec-53bf-434d-b9f1-a60671d48815 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:04.775363 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24a499ec-53bf-434d-b9f1-a60671d48815 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:04.916099 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-24a499ec-53bf-434d-b9f1-a60671d48815 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:04.924287 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-24a499ec-53bf-434d-b9f1-a60671d48815 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.161248 Jan 17 21:22:04.925097 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 119/232] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:04 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:05.624598 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2cee84eb-39bb-47aa-b6cb-e7dbdce859aa tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:05.625211 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2cee84eb-39bb-47aa-b6cb-e7dbdce859aa tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:05.627911 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-03c350d3-3a7c-4b02-9cf1-10fc19c56df3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:05.628580 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-03c350d3-3a7c-4b02-9cf1-10fc19c56df3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:05.631797 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2cee84eb-39bb-47aa-b6cb-e7dbdce859aa tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:05.632291 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2cee84eb-39bb-47aa-b6cb-e7dbdce859aa tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:05.633068 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2cee84eb-39bb-47aa-b6cb-e7dbdce859aa tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:05.633509 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2cee84eb-39bb-47aa-b6cb-e7dbdce859aa tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:05.635176 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-03c350d3-3a7c-4b02-9cf1-10fc19c56df3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:05.635625 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-03c350d3-3a7c-4b02-9cf1-10fc19c56df3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:05.636415 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-03c350d3-3a7c-4b02-9cf1-10fc19c56df3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:05.636850 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-03c350d3-3a7c-4b02-9cf1-10fc19c56df3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:05.831995 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-03c350d3-3a7c-4b02-9cf1-10fc19c56df3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:05.840448 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2cee84eb-39bb-47aa-b6cb-e7dbdce859aa tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:05.840589 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-03c350d3-3a7c-4b02-9cf1-10fc19c56df3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.216043 Jan 17 21:22:05.841070 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 120/233] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:05 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:05.847736 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2cee84eb-39bb-47aa-b6cb-e7dbdce859aa tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.226748 Jan 17 21:22:05.848293 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 114/234] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:05 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:05.942355 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d2722084-36e5-4ce1-9dfb-02568da16401 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:05.943772 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d2722084-36e5-4ce1-9dfb-02568da16401 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:05.949756 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d2722084-36e5-4ce1-9dfb-02568da16401 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:05.950216 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d2722084-36e5-4ce1-9dfb-02568da16401 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:05.951004 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d2722084-36e5-4ce1-9dfb-02568da16401 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:05.951447 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d2722084-36e5-4ce1-9dfb-02568da16401 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:06.082532 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-d2722084-36e5-4ce1-9dfb-02568da16401 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:06.090949 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d2722084-36e5-4ce1-9dfb-02568da16401 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.152182 Jan 17 21:22:06.091533 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 121/235] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:05 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:06.857381 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3798accb-9f07-4b93-89fa-9aea731faff6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:06.857984 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-3798accb-9f07-4b93-89fa-9aea731faff6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:06.864305 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3798accb-9f07-4b93-89fa-9aea731faff6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:06.864497 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7b6e8fad-f193-43c6-b2df-9f6d5b8c2710 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:06.864913 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3798accb-9f07-4b93-89fa-9aea731faff6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:06.865075 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7b6e8fad-f193-43c6-b2df-9f6d5b8c2710 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:06.865588 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3798accb-9f07-4b93-89fa-9aea731faff6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:06.866057 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3798accb-9f07-4b93-89fa-9aea731faff6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:06.871274 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7b6e8fad-f193-43c6-b2df-9f6d5b8c2710 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:06.871723 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7b6e8fad-f193-43c6-b2df-9f6d5b8c2710 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:06.872531 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7b6e8fad-f193-43c6-b2df-9f6d5b8c2710 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:06.872966 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7b6e8fad-f193-43c6-b2df-9f6d5b8c2710 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:07.061868 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-3798accb-9f07-4b93-89fa-9aea731faff6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:07.069538 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3798accb-9f07-4b93-89fa-9aea731faff6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.215710 Jan 17 21:22:07.069893 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7b6e8fad-f193-43c6-b2df-9f6d5b8c2710 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:07.070256 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 115/236] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:06 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:07.078168 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7b6e8fad-f193-43c6-b2df-9f6d5b8c2710 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.217081 Jan 17 21:22:07.078812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 122/237] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:06 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:07.108118 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-90739632-9195-4249-93d2-f57935b3a5b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:07.108761 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-90739632-9195-4249-93d2-f57935b3a5b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:07.115287 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-90739632-9195-4249-93d2-f57935b3a5b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:07.115745 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-90739632-9195-4249-93d2-f57935b3a5b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:07.116615 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-90739632-9195-4249-93d2-f57935b3a5b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:07.117019 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-90739632-9195-4249-93d2-f57935b3a5b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:07.253094 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-90739632-9195-4249-93d2-f57935b3a5b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:07.260406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-90739632-9195-4249-93d2-f57935b3a5b4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.155804 Jan 17 21:22:07.260979 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 116/238] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:07 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:07.896411 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-9488a74d-6383-4877-b685-229884deaaad req-7738e211-d5fc-4b53-8ba4-133789d772e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93682201-3212-40f2-b5b4-972db2013f23", "name": "network-vif-plugged", "status": "completed", "tag": "dc5936eb-4ad9-44d9-a2fa-30269ec3b2f0"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:07.898350 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:22:07.898350 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:22:07.905519 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-9488a74d-6383-4877-b685-229884deaaad req-7738e211-d5fc-4b53-8ba4-133789d772e7 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:07.905763 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-9488a74d-6383-4877-b685-229884deaaad req-7738e211-d5fc-4b53-8ba4-133789d772e7 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:07.916945 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-9488a74d-6383-4877-b685-229884deaaad req-7738e211-d5fc-4b53-8ba4-133789d772e7 service nova] Creating event network-vif-plugged:dc5936eb-4ad9-44d9-a2fa-30269ec3b2f0 for instance 93682201-3212-40f2-b5b4-972db2013f23 on hv-cinder-82489 Jan 17 21:22:07.921919 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-9488a74d-6383-4877-b685-229884deaaad req-7738e211-d5fc-4b53-8ba4-133789d772e7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029742 Jan 17 21:22:07.922505 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 123/239] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:08.086236 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b5e4d5a7-3bed-4731-bf5c-094394494a01 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:08.086791 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b5e4d5a7-3bed-4731-bf5c-094394494a01 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:08.093281 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b5e4d5a7-3bed-4731-bf5c-094394494a01 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:08.093728 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b5e4d5a7-3bed-4731-bf5c-094394494a01 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:08.094509 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b5e4d5a7-3bed-4731-bf5c-094394494a01 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:08.094938 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b5e4d5a7-3bed-4731-bf5c-094394494a01 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:08.095449 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-299eac51-5d69-4afb-b936-2005a618815a tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:08.096161 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-299eac51-5d69-4afb-b936-2005a618815a tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:08.102775 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-299eac51-5d69-4afb-b936-2005a618815a tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:08.102976 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-299eac51-5d69-4afb-b936-2005a618815a tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:08.105427 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-299eac51-5d69-4afb-b936-2005a618815a tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:08.105977 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-299eac51-5d69-4afb-b936-2005a618815a tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:08.283393 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b5e4d5a7-3bed-4731-bf5c-094394494a01 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:08.291117 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b5e4d5a7-3bed-4731-bf5c-094394494a01 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.208562 Jan 17 21:22:08.291684 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 117/240] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:08 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:08.296907 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1c9b5201-0745-4170-a7c1-6e0699ac1400 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:08.297417 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-299eac51-5d69-4afb-b936-2005a618815a tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:08.297636 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1c9b5201-0745-4170-a7c1-6e0699ac1400 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:08.304508 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c9b5201-0745-4170-a7c1-6e0699ac1400 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:08.305427 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-299eac51-5d69-4afb-b936-2005a618815a tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.213921 Jan 17 21:22:08.306093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 124/241] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:08 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:08.307539 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c9b5201-0745-4170-a7c1-6e0699ac1400 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:08.309855 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c9b5201-0745-4170-a7c1-6e0699ac1400 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:08.310323 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c9b5201-0745-4170-a7c1-6e0699ac1400 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:08.442341 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1c9b5201-0745-4170-a7c1-6e0699ac1400 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:08.450229 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1c9b5201-0745-4170-a7c1-6e0699ac1400 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.157603 Jan 17 21:22:08.450801 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 118/242] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:08 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:09.308052 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a1d6c729-8f73-4aff-a550-79fe2e3c2a90 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:09.309040 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a1d6c729-8f73-4aff-a550-79fe2e3c2a90 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:09.314913 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a1d6c729-8f73-4aff-a550-79fe2e3c2a90 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:09.315363 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a1d6c729-8f73-4aff-a550-79fe2e3c2a90 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:09.316313 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a1d6c729-8f73-4aff-a550-79fe2e3c2a90 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:09.316655 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a1d6c729-8f73-4aff-a550-79fe2e3c2a90 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:09.321875 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7f266afc-7ce2-4525-b04a-39ae97af19e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:09.322506 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7f266afc-7ce2-4525-b04a-39ae97af19e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:09.328312 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7f266afc-7ce2-4525-b04a-39ae97af19e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:09.329009 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7f266afc-7ce2-4525-b04a-39ae97af19e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:09.329802 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7f266afc-7ce2-4525-b04a-39ae97af19e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:09.330236 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7f266afc-7ce2-4525-b04a-39ae97af19e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:09.511213 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-a1d6c729-8f73-4aff-a550-79fe2e3c2a90 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:09.518085 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7f266afc-7ce2-4525-b04a-39ae97af19e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:09.518372 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a1d6c729-8f73-4aff-a550-79fe2e3c2a90 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.213935 Jan 17 21:22:09.518942 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 125/243] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:09 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:09.523623 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f1464484-9cef-4d8f-a2f1-c7d6b8b6e0b3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:09.524221 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f1464484-9cef-4d8f-a2f1-c7d6b8b6e0b3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:09.526572 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7f266afc-7ce2-4525-b04a-39ae97af19e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.208239 Jan 17 21:22:09.527215 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 119/244] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:09 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:09.529870 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f1464484-9cef-4d8f-a2f1-c7d6b8b6e0b3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:09.530318 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f1464484-9cef-4d8f-a2f1-c7d6b8b6e0b3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:09.531091 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f1464484-9cef-4d8f-a2f1-c7d6b8b6e0b3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:09.531522 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f1464484-9cef-4d8f-a2f1-c7d6b8b6e0b3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:09.663603 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-f1464484-9cef-4d8f-a2f1-c7d6b8b6e0b3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:09.671051 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f1464484-9cef-4d8f-a2f1-c7d6b8b6e0b3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.151172 Jan 17 21:22:09.671737 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 126/245] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:09 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:10.535349 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d9114352-0d5b-42e6-923d-5047df7fe356 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:10.535982 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d9114352-0d5b-42e6-923d-5047df7fe356 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:10.542760 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d9114352-0d5b-42e6-923d-5047df7fe356 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:10.542924 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4830202e-4db9-491f-bd15-48712e533617 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:10.543330 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d9114352-0d5b-42e6-923d-5047df7fe356 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:10.543548 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4830202e-4db9-491f-bd15-48712e533617 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:10.543982 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d9114352-0d5b-42e6-923d-5047df7fe356 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:10.544451 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d9114352-0d5b-42e6-923d-5047df7fe356 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:10.550811 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4830202e-4db9-491f-bd15-48712e533617 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:10.551494 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4830202e-4db9-491f-bd15-48712e533617 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:10.553192 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4830202e-4db9-491f-bd15-48712e533617 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:10.553848 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4830202e-4db9-491f-bd15-48712e533617 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:10.740763 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d9114352-0d5b-42e6-923d-5047df7fe356 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:10.744221 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4830202e-4db9-491f-bd15-48712e533617 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:10.748208 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d9114352-0d5b-42e6-923d-5047df7fe356 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.216436 Jan 17 21:22:10.748803 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 120/246] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:10 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:10.752019 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4830202e-4db9-491f-bd15-48712e533617 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.212306 Jan 17 21:22:10.752752 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 127/247] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:10 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:10.753041 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-9011d1fb-e29c-42f6-bf80-a13b2509a009 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:10.753635 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-9011d1fb-e29c-42f6-bf80-a13b2509a009 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:10.759867 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9011d1fb-e29c-42f6-bf80-a13b2509a009 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:10.760365 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9011d1fb-e29c-42f6-bf80-a13b2509a009 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:10.761172 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9011d1fb-e29c-42f6-bf80-a13b2509a009 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:10.761605 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9011d1fb-e29c-42f6-bf80-a13b2509a009 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:10.895664 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-9011d1fb-e29c-42f6-bf80-a13b2509a009 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:10.903834 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-9011d1fb-e29c-42f6-bf80-a13b2509a009 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.153985 Jan 17 21:22:10.904487 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 121/248] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:10 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:11.769079 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ebd905ea-9111-4a8e-938f-84ab2b0f741f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:11.769759 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ebd905ea-9111-4a8e-938f-84ab2b0f741f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:11.770065 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-9e57b197-c412-42ac-baf2-b1325f1c34b9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:11.770728 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-9e57b197-c412-42ac-baf2-b1325f1c34b9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:11.777550 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9e57b197-c412-42ac-baf2-b1325f1c34b9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:11.778004 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9e57b197-c412-42ac-baf2-b1325f1c34b9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:11.778801 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9e57b197-c412-42ac-baf2-b1325f1c34b9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:11.779286 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9e57b197-c412-42ac-baf2-b1325f1c34b9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:11.780604 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebd905ea-9111-4a8e-938f-84ab2b0f741f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:11.781537 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebd905ea-9111-4a8e-938f-84ab2b0f741f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:11.782636 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebd905ea-9111-4a8e-938f-84ab2b0f741f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:11.783279 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebd905ea-9111-4a8e-938f-84ab2b0f741f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:11.989745 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-9e57b197-c412-42ac-baf2-b1325f1c34b9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:11.997599 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-9e57b197-c412-42ac-baf2-b1325f1c34b9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1314 microversion: 2.1 time: 0.231197 Jan 17 21:22:11.998178 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 122/249] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:11 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:12.011609 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3241f085-1683-4220-9483-7ea57a5d3220 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:12.012218 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-3241f085-1683-4220-9483-7ea57a5d3220 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:12.018340 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ebd905ea-9111-4a8e-938f-84ab2b0f741f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:12.018626 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3241f085-1683-4220-9483-7ea57a5d3220 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:12.019099 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3241f085-1683-4220-9483-7ea57a5d3220 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:12.019902 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3241f085-1683-4220-9483-7ea57a5d3220 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:12.020347 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3241f085-1683-4220-9483-7ea57a5d3220 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:12.027439 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ebd905ea-9111-4a8e-938f-84ab2b0f741f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.265023 Jan 17 21:22:12.028296 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 128/250] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:11 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:12.163606 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-3241f085-1683-4220-9483-7ea57a5d3220 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:12.173770 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3241f085-1683-4220-9483-7ea57a5d3220 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.165311 Jan 17 21:22:12.174701 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 123/251] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:11 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:13.014088 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-20385ad5-1ae5-4786-99e0-840345f842e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:13.014731 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-20385ad5-1ae5-4786-99e0-840345f842e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:13.021324 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-20385ad5-1ae5-4786-99e0-840345f842e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:13.021795 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-20385ad5-1ae5-4786-99e0-840345f842e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:13.022601 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-20385ad5-1ae5-4786-99e0-840345f842e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:13.023001 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-20385ad5-1ae5-4786-99e0-840345f842e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:13.045507 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1b315ffb-6993-45c6-8d70-e69d13a76cdc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:13.046256 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1b315ffb-6993-45c6-8d70-e69d13a76cdc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:13.057792 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1b315ffb-6993-45c6-8d70-e69d13a76cdc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:13.058651 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1b315ffb-6993-45c6-8d70-e69d13a76cdc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:13.059620 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1b315ffb-6993-45c6-8d70-e69d13a76cdc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:13.060061 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1b315ffb-6993-45c6-8d70-e69d13a76cdc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:13.334795 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-20385ad5-1ae5-4786-99e0-840345f842e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:13.343008 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-20385ad5-1ae5-4786-99e0-840345f842e0 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1499 microversion: 2.1 time: 0.332453 Jan 17 21:22:13.343431 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 129/252] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:13 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1499 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:13.348243 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b3290f24-3d12-4c91-972f-7bd1b19bdd41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:13.349382 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b3290f24-3d12-4c91-972f-7bd1b19bdd41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:13.365190 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b3290f24-3d12-4c91-972f-7bd1b19bdd41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:13.365782 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b3290f24-3d12-4c91-972f-7bd1b19bdd41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:13.366849 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b3290f24-3d12-4c91-972f-7bd1b19bdd41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:13.367237 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b3290f24-3d12-4c91-972f-7bd1b19bdd41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:13.368993 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1b315ffb-6993-45c6-8d70-e69d13a76cdc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:13.390471 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1b315ffb-6993-45c6-8d70-e69d13a76cdc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.348600 Jan 17 21:22:13.391327 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 124/253] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:13 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:13.559006 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b3290f24-3d12-4c91-972f-7bd1b19bdd41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:13.566623 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b3290f24-3d12-4c91-972f-7bd1b19bdd41 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.221904 Jan 17 21:22:13.567193 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 130/254] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:13 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:14.406681 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-bbef0bcf-daf1-4934-a20d-4acff4bfd215 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:14.407294 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-bbef0bcf-daf1-4934-a20d-4acff4bfd215 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:14.415013 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bbef0bcf-daf1-4934-a20d-4acff4bfd215 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:14.415913 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bbef0bcf-daf1-4934-a20d-4acff4bfd215 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:14.416894 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bbef0bcf-daf1-4934-a20d-4acff4bfd215 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:14.418307 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bbef0bcf-daf1-4934-a20d-4acff4bfd215 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:14.555246 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-bbef0bcf-daf1-4934-a20d-4acff4bfd215 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:14.562951 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-bbef0bcf-daf1-4934-a20d-4acff4bfd215 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.159819 Jan 17 21:22:14.564075 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 125/255] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:14 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:14.585113 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3d5f7293-0678-4558-b2df-531343744957 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:14.585711 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3d5f7293-0678-4558-b2df-531343744957 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:14.592598 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3d5f7293-0678-4558-b2df-531343744957 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:14.593266 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3d5f7293-0678-4558-b2df-531343744957 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:14.594053 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3d5f7293-0678-4558-b2df-531343744957 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:14.594491 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3d5f7293-0678-4558-b2df-531343744957 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:14.741401 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3d5f7293-0678-4558-b2df-531343744957 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:14.750539 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3d5f7293-0678-4558-b2df-531343744957 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.169667 Jan 17 21:22:14.751613 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 131/256] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:14 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:14.998207 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-0ca8e017-88d9-496e-9e55-77b4062e9b78 req-e47a853b-fd83-49f5-aab1-8b09506cf5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de27f69-552a-4922-8576-4163c4c8bfb0", "name": "network-vif-plugged", "status": "completed", "tag": "0371bc2b-703b-41a8-b868-151139132091"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:15.000410 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:22:15.000410 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:22:15.011553 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-0ca8e017-88d9-496e-9e55-77b4062e9b78 req-e47a853b-fd83-49f5-aab1-8b09506cf5d5 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:15.012019 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-0ca8e017-88d9-496e-9e55-77b4062e9b78 req-e47a853b-fd83-49f5-aab1-8b09506cf5d5 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:15.025973 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-0ca8e017-88d9-496e-9e55-77b4062e9b78 req-e47a853b-fd83-49f5-aab1-8b09506cf5d5 service nova] Creating event network-vif-plugged:0371bc2b-703b-41a8-b868-151139132091 for instance 3de27f69-552a-4922-8576-4163c4c8bfb0 on hv-cinder-82489 Jan 17 21:22:15.031112 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-0ca8e017-88d9-496e-9e55-77b4062e9b78 req-e47a853b-fd83-49f5-aab1-8b09506cf5d5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037609 Jan 17 21:22:15.031916 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 126/257] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:15.580119 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1ec6e710-0d63-4a4b-996a-e10c1e56306b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:15.580766 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1ec6e710-0d63-4a4b-996a-e10c1e56306b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:15.587242 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1ec6e710-0d63-4a4b-996a-e10c1e56306b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:15.587792 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1ec6e710-0d63-4a4b-996a-e10c1e56306b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:15.588089 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1ec6e710-0d63-4a4b-996a-e10c1e56306b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:15.588601 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1ec6e710-0d63-4a4b-996a-e10c1e56306b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:15.724305 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1ec6e710-0d63-4a4b-996a-e10c1e56306b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:15.732223 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1ec6e710-0d63-4a4b-996a-e10c1e56306b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.156362 Jan 17 21:22:15.732851 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 132/258] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:15 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:15.769085 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-9ef391e0-ac10-4ce5-ba29-8752c27e0163 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:15.769776 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-9ef391e0-ac10-4ce5-ba29-8752c27e0163 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:15.776434 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9ef391e0-ac10-4ce5-ba29-8752c27e0163 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:15.776892 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9ef391e0-ac10-4ce5-ba29-8752c27e0163 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:15.777673 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9ef391e0-ac10-4ce5-ba29-8752c27e0163 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:15.778106 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9ef391e0-ac10-4ce5-ba29-8752c27e0163 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:15.913208 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-9ef391e0-ac10-4ce5-ba29-8752c27e0163 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:15.920767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-9ef391e0-ac10-4ce5-ba29-8752c27e0163 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.155654 Jan 17 21:22:15.921340 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 127/259] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:15 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:16.748657 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-51e5d899-b7a4-4597-a065-ce0a634d018a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:16.749268 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-51e5d899-b7a4-4597-a065-ce0a634d018a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:16.755828 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-51e5d899-b7a4-4597-a065-ce0a634d018a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:16.756150 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-51e5d899-b7a4-4597-a065-ce0a634d018a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:16.756959 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-51e5d899-b7a4-4597-a065-ce0a634d018a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:16.757394 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-51e5d899-b7a4-4597-a065-ce0a634d018a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:16.898461 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-51e5d899-b7a4-4597-a065-ce0a634d018a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:16.909044 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-51e5d899-b7a4-4597-a065-ce0a634d018a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.163865 Jan 17 21:22:16.909789 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 133/260] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:16 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:16.937890 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-519f4490-50bf-46dc-b085-50a2f9d93df8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:16.938503 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-519f4490-50bf-46dc-b085-50a2f9d93df8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:16.945383 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-519f4490-50bf-46dc-b085-50a2f9d93df8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:16.945832 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-519f4490-50bf-46dc-b085-50a2f9d93df8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:16.946612 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-519f4490-50bf-46dc-b085-50a2f9d93df8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:16.947045 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-519f4490-50bf-46dc-b085-50a2f9d93df8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:17.093472 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-519f4490-50bf-46dc-b085-50a2f9d93df8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:17.101590 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-519f4490-50bf-46dc-b085-50a2f9d93df8 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.167636 Jan 17 21:22:17.102177 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 128/261] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:16 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:17.926288 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4914e295-e7e8-40d0-9e76-3546c25df911 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:17.926908 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4914e295-e7e8-40d0-9e76-3546c25df911 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:17.933271 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4914e295-e7e8-40d0-9e76-3546c25df911 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:17.933732 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4914e295-e7e8-40d0-9e76-3546c25df911 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:17.934517 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4914e295-e7e8-40d0-9e76-3546c25df911 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:17.934969 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4914e295-e7e8-40d0-9e76-3546c25df911 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:18.077369 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4914e295-e7e8-40d0-9e76-3546c25df911 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:18.084564 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4914e295-e7e8-40d0-9e76-3546c25df911 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.161963 Jan 17 21:22:18.085117 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 134/262] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:17 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:18.119482 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-014291f9-490c-4a5d-bd0d-40fa232ef52b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:18.120196 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-014291f9-490c-4a5d-bd0d-40fa232ef52b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:18.126090 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-014291f9-490c-4a5d-bd0d-40fa232ef52b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:18.126554 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-014291f9-490c-4a5d-bd0d-40fa232ef52b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:18.127336 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-014291f9-490c-4a5d-bd0d-40fa232ef52b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:18.127781 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-014291f9-490c-4a5d-bd0d-40fa232ef52b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:18.254217 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-014291f9-490c-4a5d-bd0d-40fa232ef52b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:18.261509 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-014291f9-490c-4a5d-bd0d-40fa232ef52b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.145656 Jan 17 21:22:18.262066 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 129/263] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:18 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:18.793042 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-81dd6f09-5629-40b8-9a69-f84a2fe997c7 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:18.793445 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-81dd6f09-5629-40b8-9a69-f84a2fe997c7 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:18.799264 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-81dd6f09-5629-40b8-9a69-f84a2fe997c7 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:18.799745 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-81dd6f09-5629-40b8-9a69-f84a2fe997c7 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:18.800644 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-81dd6f09-5629-40b8-9a69-f84a2fe997c7 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:18.801136 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-81dd6f09-5629-40b8-9a69-f84a2fe997c7 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:18.827610 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-81dd6f09-5629-40b8-9a69-f84a2fe997c7 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Going to try to terminate instance {{(pid=116183) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:22:18.909469 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-81dd6f09-5629-40b8-9a69-f84a2fe997c7 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "DELETE /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 204 len: 0 microversion: 2.1 time: 0.119722 Jan 17 21:22:18.910074 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 135/264] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:22:18 2022] DELETE /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:22:18.918033 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fd377b2e-2d6f-42cd-993e-80fbb75b9819 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:18.918641 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fd377b2e-2d6f-42cd-993e-80fbb75b9819 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:18.924701 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd377b2e-2d6f-42cd-993e-80fbb75b9819 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:18.925153 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd377b2e-2d6f-42cd-993e-80fbb75b9819 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:18.925935 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd377b2e-2d6f-42cd-993e-80fbb75b9819 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:18.926372 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd377b2e-2d6f-42cd-993e-80fbb75b9819 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:19.065675 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-fd377b2e-2d6f-42cd-993e-80fbb75b9819 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:19.074298 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fd377b2e-2d6f-42cd-993e-80fbb75b9819 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1505 microversion: 2.1 time: 0.159804 Jan 17 21:22:19.074962 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 130/265] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:18 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:19.108016 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-82584a8c-b604-4d4d-96d6-1a576332f087 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:19.110980 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-82584a8c-b604-4d4d-96d6-1a576332f087 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:19.123089 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-82584a8c-b604-4d4d-96d6-1a576332f087 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:19.123911 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-82584a8c-b604-4d4d-96d6-1a576332f087 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:19.128486 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-82584a8c-b604-4d4d-96d6-1a576332f087 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:19.128486 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-82584a8c-b604-4d4d-96d6-1a576332f087 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:19.278388 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fa1680d9-2930-4eec-b877-13fb9c027e4d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:19.278998 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fa1680d9-2930-4eec-b877-13fb9c027e4d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:19.284259 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-82584a8c-b604-4d4d-96d6-1a576332f087 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:19.285441 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fa1680d9-2930-4eec-b877-13fb9c027e4d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:19.285901 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fa1680d9-2930-4eec-b877-13fb9c027e4d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:19.286698 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fa1680d9-2930-4eec-b877-13fb9c027e4d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:19.287373 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fa1680d9-2930-4eec-b877-13fb9c027e4d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:19.292340 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-82584a8c-b604-4d4d-96d6-1a576332f087 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1317 microversion: 2.1 time: 0.191880 Jan 17 21:22:19.293162 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 136/266] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:19 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:19.425728 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-fa1680d9-2930-4eec-b877-13fb9c027e4d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:19.433718 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fa1680d9-2930-4eec-b877-13fb9c027e4d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.158963 Jan 17 21:22:19.434303 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 131/267] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:19 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:20.092148 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4f83d8c4-f48d-40b3-9a18-8421af4ef3fd tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:20.092903 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4f83d8c4-f48d-40b3-9a18-8421af4ef3fd tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:20.098855 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4f83d8c4-f48d-40b3-9a18-8421af4ef3fd tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:20.099902 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4f83d8c4-f48d-40b3-9a18-8421af4ef3fd tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:20.100737 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4f83d8c4-f48d-40b3-9a18-8421af4ef3fd tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:20.101783 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4f83d8c4-f48d-40b3-9a18-8421af4ef3fd tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:20.249973 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4f83d8c4-f48d-40b3-9a18-8421af4ef3fd tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:20.258179 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4f83d8c4-f48d-40b3-9a18-8421af4ef3fd tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1505 microversion: 2.1 time: 0.169875 Jan 17 21:22:20.260407 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 137/268] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:20 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:20.311975 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-854337f5-9579-40a4-85f2-24d193a0055a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:20.312972 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-854337f5-9579-40a4-85f2-24d193a0055a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:20.319474 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-854337f5-9579-40a4-85f2-24d193a0055a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:20.319926 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-854337f5-9579-40a4-85f2-24d193a0055a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:20.320749 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-854337f5-9579-40a4-85f2-24d193a0055a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:20.321198 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-854337f5-9579-40a4-85f2-24d193a0055a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:20.451844 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0b941d71-18d1-46c5-92dc-3b5a6e7e9743 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:20.452503 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-0b941d71-18d1-46c5-92dc-3b5a6e7e9743 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:20.456292 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-854337f5-9579-40a4-85f2-24d193a0055a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:20.458361 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0b941d71-18d1-46c5-92dc-3b5a6e7e9743 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:20.459351 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0b941d71-18d1-46c5-92dc-3b5a6e7e9743 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:20.460140 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0b941d71-18d1-46c5-92dc-3b5a6e7e9743 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:20.460608 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0b941d71-18d1-46c5-92dc-3b5a6e7e9743 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:20.465017 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-854337f5-9579-40a4-85f2-24d193a0055a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1507 microversion: 2.1 time: 0.156705 Jan 17 21:22:20.465593 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 132/269] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:20 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:20.607830 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-0b941d71-18d1-46c5-92dc-3b5a6e7e9743 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:20.615512 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-0b941d71-18d1-46c5-92dc-3b5a6e7e9743 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.167200 Jan 17 21:22:20.616092 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 138/270] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:20 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:21.290226 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-751bd42c-67bf-4c2f-9c2c-8cea7c7213c9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:21.293071 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-751bd42c-67bf-4c2f-9c2c-8cea7c7213c9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:21.309324 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-751bd42c-67bf-4c2f-9c2c-8cea7c7213c9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:21.310043 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-751bd42c-67bf-4c2f-9c2c-8cea7c7213c9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:21.311350 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-751bd42c-67bf-4c2f-9c2c-8cea7c7213c9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:21.312073 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-751bd42c-67bf-4c2f-9c2c-8cea7c7213c9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:21.529595 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-751bd42c-67bf-4c2f-9c2c-8cea7c7213c9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:21.538751 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-751bd42c-67bf-4c2f-9c2c-8cea7c7213c9 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1505 microversion: 2.1 time: 0.264958 Jan 17 21:22:21.539338 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 133/271] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:21 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:21.632639 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-80508b15-9540-4283-97fe-2686a4903c76 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:21.633404 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-80508b15-9540-4283-97fe-2686a4903c76 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:21.639893 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-80508b15-9540-4283-97fe-2686a4903c76 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:21.640473 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-80508b15-9540-4283-97fe-2686a4903c76 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:21.641277 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-80508b15-9540-4283-97fe-2686a4903c76 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:21.641721 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-80508b15-9540-4283-97fe-2686a4903c76 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:21.918960 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-752d475f-ab89-4ec4-b476-85e55786acdd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "421af2cf-dfdc-4163-9ab3-483bc73791bb"}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:21.920221 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-752d475f-ab89-4ec4-b476-85e55786acdd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:21.929845 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-752d475f-ab89-4ec4-b476-85e55786acdd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:21.930498 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-752d475f-ab89-4ec4-b476-85e55786acdd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:21.931763 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-752d475f-ab89-4ec4-b476-85e55786acdd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:21.932738 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-752d475f-ab89-4ec4-b476-85e55786acdd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:22.061434 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-80508b15-9540-4283-97fe-2686a4903c76 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:22.069870 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-80508b15-9540-4283-97fe-2686a4903c76 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.441251 Jan 17 21:22:22.070552 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 139/272] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:21 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:22.272325 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-752d475f-ab89-4ec4-b476-85e55786acdd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "POST /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358363 Jan 17 21:22:22.277765 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 134/273] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jan 17 21:22:21 2022] POST /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:22.464950 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-e1dde4b2-2579-4d90-856d-0e7fb36222e0 req-609c93f3-17b9-4863-b1fa-53089c55c790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93682201-3212-40f2-b5b4-972db2013f23", "name": "network-vif-deleted", "tag": "dc5936eb-4ad9-44d9-a2fa-30269ec3b2f0"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:22.466245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:22:22.466245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:22:22.475087 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-e1dde4b2-2579-4d90-856d-0e7fb36222e0 req-609c93f3-17b9-4863-b1fa-53089c55c790 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:22.475571 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-e1dde4b2-2579-4d90-856d-0e7fb36222e0 req-609c93f3-17b9-4863-b1fa-53089c55c790 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:22.486988 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-e1dde4b2-2579-4d90-856d-0e7fb36222e0 req-609c93f3-17b9-4863-b1fa-53089c55c790 service nova] Creating event network-vif-deleted:dc5936eb-4ad9-44d9-a2fa-30269ec3b2f0 for instance 93682201-3212-40f2-b5b4-972db2013f23 on hv-cinder-82489 Jan 17 21:22:22.492328 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-e1dde4b2-2579-4d90-856d-0e7fb36222e0 req-609c93f3-17b9-4863-b1fa-53089c55c790 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031527 Jan 17 21:22:22.492960 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 140/274] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:22.559063 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f79396bc-eec2-4caf-9c62-0ac8a6f9c36c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:22.559763 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f79396bc-eec2-4caf-9c62-0ac8a6f9c36c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:22.565885 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f79396bc-eec2-4caf-9c62-0ac8a6f9c36c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:22.566339 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f79396bc-eec2-4caf-9c62-0ac8a6f9c36c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:22.567126 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f79396bc-eec2-4caf-9c62-0ac8a6f9c36c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:22.567668 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f79396bc-eec2-4caf-9c62-0ac8a6f9c36c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:22.601509 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f79396bc-eec2-4caf-9c62-0ac8a6f9c36c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:22.601959 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f79396bc-eec2-4caf-9c62-0ac8a6f9c36c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:22.602431 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-f79396bc-eec2-4caf-9c62-0ac8a6f9c36c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lazy-loading 'fault' on Instance uuid 93682201-3212-40f2-b5b4-972db2013f23 {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:22:22.647051 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f79396bc-eec2-4caf-9c62-0ac8a6f9c36c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:22.654320 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f79396bc-eec2-4caf-9c62-0ac8a6f9c36c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 200 len: 1304 microversion: 2.1 time: 0.099728 Jan 17 21:22:22.654815 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 135/275] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:22 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:23.042932 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-321429135", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452", "networks": [{"uuid": "43394bed-ee66-490e-9c2d-38204c292668"}]}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:23.088271 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ae912af1-acee-4170-ab3b-b262923de633 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:23.089635 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ae912af1-acee-4170-ab3b-b262923de633 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:23.096900 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ae912af1-acee-4170-ab3b-b262923de633 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:23.097354 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ae912af1-acee-4170-ab3b-b262923de633 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:23.098151 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ae912af1-acee-4170-ab3b-b262923de633 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:23.098600 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ae912af1-acee-4170-ab3b-b262923de633 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:23.106916 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.network.neutron [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] validate_networks() for [('43394bed-ee66-490e-9c2d-38204c292668', None, None, None, None, None)] {{(pid=116183) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:22:23.356726 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ae912af1-acee-4170-ab3b-b262923de633 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:23.372267 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ae912af1-acee-4170-ab3b-b262923de633 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1500 microversion: 2.1 time: 0.288779 Jan 17 21:22:23.385155 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 136/276] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:23 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1500 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:23.390905 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a4fbb4fa-7766-44b3-9f5f-fdc8ae90c9eb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0b9dfd7-caa9-4432-87dd-1ebf160e4393"}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:23.403041 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a4fbb4fa-7766-44b3-9f5f-fdc8ae90c9eb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:23.411096 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4fbb4fa-7766-44b3-9f5f-fdc8ae90c9eb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:23.412407 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4fbb4fa-7766-44b3-9f5f-fdc8ae90c9eb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:23.413672 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4fbb4fa-7766-44b3-9f5f-fdc8ae90c9eb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:23.414301 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4fbb4fa-7766-44b3-9f5f-fdc8ae90c9eb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:23.442488 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-a4fbb4fa-7766-44b3-9f5f-fdc8ae90c9eb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] HTTP exception thrown: Cannot 'attach_volume' instance 8a5818e4-0026-4597-9ef3-d539c2cdee97 while it is in vm_state rescued Jan 17 21:22:23.444025 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a4fbb4fa-7766-44b3-9f5f-fdc8ae90c9eb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Returning 409 to user: Cannot 'attach_volume' instance 8a5818e4-0026-4597-9ef3-d539c2cdee97 while it is in vm_state rescued {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:22:23.445045 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a4fbb4fa-7766-44b3-9f5f-fdc8ae90c9eb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "POST /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.058628 Jan 17 21:22:23.445753 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 137/277] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jan 17 21:22:23 2022] POST /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments => generated 152 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 17 21:22:23.454236 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3f1dedbf-1c5c-4604-b0d5-5e04693616db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:23.455000 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-3f1dedbf-1c5c-4604-b0d5-5e04693616db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:23.461372 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3f1dedbf-1c5c-4604-b0d5-5e04693616db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:23.461831 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3f1dedbf-1c5c-4604-b0d5-5e04693616db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:23.462623 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3f1dedbf-1c5c-4604-b0d5-5e04693616db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:23.463062 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3f1dedbf-1c5c-4604-b0d5-5e04693616db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:23.553324 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3f1dedbf-1c5c-4604-b0d5-5e04693616db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "POST /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/action" status: 202 len: 0 microversion: 2.1 time: 0.102385 Jan 17 21:22:23.553958 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 138/278] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:22:23 2022] POST /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:22:23.564649 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1d71b21b-33cb-439b-b347-59a21fefbfe0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:23.566234 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1d71b21b-33cb-439b-b347-59a21fefbfe0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:23.574695 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d71b21b-33cb-439b-b347-59a21fefbfe0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:23.575144 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d71b21b-33cb-439b-b347-59a21fefbfe0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:23.576869 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d71b21b-33cb-439b-b347-59a21fefbfe0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:23.577573 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d71b21b-33cb-439b-b347-59a21fefbfe0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:23.590184 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Flavor limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:22:23.590961 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Image limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:22:23.591723 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Flavor pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:22:23.592536 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Image pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:22:23.593089 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:22:23.603508 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:23.604184 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:23.605210 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:23.605833 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:23.634638 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Getting quotas for project f7ac0b68ef1544aa94c22825c7307849. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:22:23.638989 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Getting quotas for user 831aba98d11643aab4321dfa499e1d42 and project f7ac0b68ef1544aa94c22825c7307849. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:22:23.651281 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Going to run 1 instances... {{(pid=116183) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:22:23.653928 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:22:23.703644 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-9b018c4c-f0e5-4f2a-be9a-485e9abf6dea tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667587 Jan 17 21:22:23.704923 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 141/279] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:22:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:22:23.710096 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-bbad2888-9a34-48d3-832d-cfce204ee471 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:23.710901 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-bbad2888-9a34-48d3-832d-cfce204ee471 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: 93682201-3212-40f2-b5b4-972db2013f23] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:23.717681 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bbad2888-9a34-48d3-832d-cfce204ee471 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:23.718409 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bbad2888-9a34-48d3-832d-cfce204ee471 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:23.719380 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bbad2888-9a34-48d3-832d-cfce204ee471 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:23.719985 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bbad2888-9a34-48d3-832d-cfce204ee471 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:23.743944 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-bbad2888-9a34-48d3-832d-cfce204ee471 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] HTTP exception thrown: Instance 93682201-3212-40f2-b5b4-972db2013f23 could not be found. Jan 17 21:22:23.744657 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-bbad2888-9a34-48d3-832d-cfce204ee471 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Returning 404 to user: Instance 93682201-3212-40f2-b5b4-972db2013f23 could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:22:23.745503 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-bbad2888-9a34-48d3-832d-cfce204ee471 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23" status: 404 len: 111 microversion: 2.1 time: 0.039436 Jan 17 21:22:23.749616 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 142/280] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:23 2022] GET /compute/v2.1/servers/93682201-3212-40f2-b5b4-972db2013f23 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:22:23.754194 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-13c932a8-8e10-49cf-b7b8-990665b3adf8 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:23.755006 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-13c932a8-8e10-49cf-b7b8-990665b3adf8 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:23.934028 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-13c932a8-8e10-49cf-b7b8-990665b3adf8 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:23.943659 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-13c932a8-8e10-49cf-b7b8-990665b3adf8 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1218 microversion: 2.1 time: 0.192521 Jan 17 21:22:23.945195 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 143/281] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:23 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1218 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:23.966122 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-185140530", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452", "networks": [{"uuid": "26db734b-a4bb-4f2a-8d18-dbe8b6a57647"}]}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:23.969521 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1d71b21b-33cb-439b-b347-59a21fefbfe0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:23.979819 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1d71b21b-33cb-439b-b347-59a21fefbfe0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1508 microversion: 2.1 time: 0.420313 Jan 17 21:22:23.981189 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 139/282] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:23 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1508 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:24.039389 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.network.neutron [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] validate_networks() for [('26db734b-a4bb-4f2a-8d18-dbe8b6a57647', None, None, None, None, None)] {{(pid=116183) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:22:24.580719 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Flavor limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:22:24.581614 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Image limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:22:24.581724 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Flavor pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:22:24.582129 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Image pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:22:24.582465 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:22:24.591689 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:24.592240 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:24.593016 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:24.593459 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:24.609765 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Getting quotas for project 950cb12ecf9943fa811a11b8a46aeefc. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:22:24.614856 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Getting quotas for user ab0163c5068748eb88921dd43dd762b6 and project 950cb12ecf9943fa811a11b8a46aeefc. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:22:24.627776 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Going to run 1 instances... {{(pid=116183) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:22:24.630642 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:22:24.675853 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-dcecdaf7-4442-42b5-a356-aeddeb212085 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728524 Jan 17 21:22:24.677423 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 144/283] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:22:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:22:24.687846 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-60ee8f0b-09ca-4c76-9d35-ec693dc3ed56 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:24.688992 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-60ee8f0b-09ca-4c76-9d35-ec693dc3ed56 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:24.752134 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-60ee8f0b-09ca-4c76-9d35-ec693dc3ed56 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:24.760395 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-60ee8f0b-09ca-4c76-9d35-ec693dc3ed56 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1213 microversion: 2.1 time: 0.077115 Jan 17 21:22:24.760982 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 140/284] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:24 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:24.969430 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-bda2946b-9fbe-4bc3-abae-8e59ea4efaf9 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:24.973459 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-bda2946b-9fbe-4bc3-abae-8e59ea4efaf9 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:24.997638 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-44d54c42-68ab-4f70-a848-baf016da675b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:24.998344 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-44d54c42-68ab-4f70-a848-baf016da675b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:25.002582 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bda2946b-9fbe-4bc3-abae-8e59ea4efaf9 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:25.006092 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-44d54c42-68ab-4f70-a848-baf016da675b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:25.009633 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bda2946b-9fbe-4bc3-abae-8e59ea4efaf9 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:25.010205 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-44d54c42-68ab-4f70-a848-baf016da675b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:25.011182 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bda2946b-9fbe-4bc3-abae-8e59ea4efaf9 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:25.012171 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-44d54c42-68ab-4f70-a848-baf016da675b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:25.012978 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bda2946b-9fbe-4bc3-abae-8e59ea4efaf9 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:25.020795 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-44d54c42-68ab-4f70-a848-baf016da675b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:25.158194 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-bda2946b-9fbe-4bc3-abae-8e59ea4efaf9 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:25.170289 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-bda2946b-9fbe-4bc3-abae-8e59ea4efaf9 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1270 microversion: 2.1 time: 0.209518 Jan 17 21:22:25.171713 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 145/285] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:24 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1270 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:25.269965 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-44d54c42-68ab-4f70-a848-baf016da675b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:25.289859 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-44d54c42-68ab-4f70-a848-baf016da675b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1508 microversion: 2.1 time: 0.295544 Jan 17 21:22:25.290458 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 141/286] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:24 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1508 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:25.779377 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e76ee389-0d78-4c1f-b51a-3c75f289dcbf tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:25.780686 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-e76ee389-0d78-4c1f-b51a-3c75f289dcbf tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:25.787762 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e76ee389-0d78-4c1f-b51a-3c75f289dcbf tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:25.788309 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e76ee389-0d78-4c1f-b51a-3c75f289dcbf tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:25.789228 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e76ee389-0d78-4c1f-b51a-3c75f289dcbf tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:25.789759 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e76ee389-0d78-4c1f-b51a-3c75f289dcbf tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:25.874535 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-e76ee389-0d78-4c1f-b51a-3c75f289dcbf tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:25.882312 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e76ee389-0d78-4c1f-b51a-3c75f289dcbf tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1265 microversion: 2.1 time: 0.107121 Jan 17 21:22:25.883110 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 146/287] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:25 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:26.189820 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-96768b7b-0e28-4d6c-9740-84f7f0a1d409 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:26.191008 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-96768b7b-0e28-4d6c-9740-84f7f0a1d409 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:26.205577 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-96768b7b-0e28-4d6c-9740-84f7f0a1d409 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:26.206048 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-96768b7b-0e28-4d6c-9740-84f7f0a1d409 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:26.211925 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-96768b7b-0e28-4d6c-9740-84f7f0a1d409 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:26.213530 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-96768b7b-0e28-4d6c-9740-84f7f0a1d409 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:26.308452 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d4d6bae0-75c9-465f-aed6-ac8580fbf75b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:26.309647 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d4d6bae0-75c9-465f-aed6-ac8580fbf75b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:26.327056 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4d6bae0-75c9-465f-aed6-ac8580fbf75b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:26.328698 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4d6bae0-75c9-465f-aed6-ac8580fbf75b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:26.330105 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4d6bae0-75c9-465f-aed6-ac8580fbf75b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:26.330551 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4d6bae0-75c9-465f-aed6-ac8580fbf75b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:26.619419 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-96768b7b-0e28-4d6c-9740-84f7f0a1d409 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:26.628445 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-96768b7b-0e28-4d6c-9740-84f7f0a1d409 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1318 microversion: 2.1 time: 0.442755 Jan 17 21:22:26.629037 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 142/288] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:26 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:26.877971 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-d4d6bae0-75c9-465f-aed6-ac8580fbf75b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:26.895865 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d4d6bae0-75c9-465f-aed6-ac8580fbf75b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1508 microversion: 2.1 time: 0.591842 Jan 17 21:22:26.897343 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 147/289] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:26 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1508 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:26.914988 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d8fcab2d-d79c-40be-a029-0de4448e948f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:26.921188 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d8fcab2d-d79c-40be-a029-0de4448e948f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:26.935203 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d8fcab2d-d79c-40be-a029-0de4448e948f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:26.936888 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d8fcab2d-d79c-40be-a029-0de4448e948f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:26.938148 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d8fcab2d-d79c-40be-a029-0de4448e948f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:26.939175 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d8fcab2d-d79c-40be-a029-0de4448e948f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:27.235537 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d8fcab2d-d79c-40be-a029-0de4448e948f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:27.249980 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d8fcab2d-d79c-40be-a029-0de4448e948f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1313 microversion: 2.1 time: 0.343263 Jan 17 21:22:27.256464 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 143/290] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:26 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:27.649251 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5ed82658-3d3e-4d16-ae9f-1416ccfedbb3 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:27.649871 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5ed82658-3d3e-4d16-ae9f-1416ccfedbb3 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:27.650204 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-e1fb1b8f-a6e6-4bef-8ea7-1ad1e352ec33 req-c5ec8309-7f83-4d23-beb9-4b4f5d496553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6ecab4-ad67-494d-8290-50992425966f", "tag": "0f32a145-2070-4f51-b7d2-0671cb8e4109"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:27.651924 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:22:27.651924 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:22:27.663270 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5ed82658-3d3e-4d16-ae9f-1416ccfedbb3 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:27.665122 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5ed82658-3d3e-4d16-ae9f-1416ccfedbb3 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:27.666008 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5ed82658-3d3e-4d16-ae9f-1416ccfedbb3 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:27.671748 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5ed82658-3d3e-4d16-ae9f-1416ccfedbb3 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:27.697037 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-e1fb1b8f-a6e6-4bef-8ea7-1ad1e352ec33 req-c5ec8309-7f83-4d23-beb9-4b4f5d496553 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:27.697492 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-e1fb1b8f-a6e6-4bef-8ea7-1ad1e352ec33 req-c5ec8309-7f83-4d23-beb9-4b4f5d496553 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:27.722682 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-e1fb1b8f-a6e6-4bef-8ea7-1ad1e352ec33 req-c5ec8309-7f83-4d23-beb9-4b4f5d496553 service nova] Creating event network-changed:0f32a145-2070-4f51-b7d2-0671cb8e4109 for instance 1a6ecab4-ad67-494d-8290-50992425966f on hv-cinder-82489 Jan 17 21:22:27.738021 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-e1fb1b8f-a6e6-4bef-8ea7-1ad1e352ec33 req-c5ec8309-7f83-4d23-beb9-4b4f5d496553 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094039 Jan 17 21:22:27.741500 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 148/291] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:27.913822 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-80151f0d-e04b-421f-aab0-bdd3dea8b90c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:27.914642 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-80151f0d-e04b-421f-aab0-bdd3dea8b90c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:27.926641 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-80151f0d-e04b-421f-aab0-bdd3dea8b90c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:27.927277 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-80151f0d-e04b-421f-aab0-bdd3dea8b90c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:27.928706 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-80151f0d-e04b-421f-aab0-bdd3dea8b90c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:27.929765 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-80151f0d-e04b-421f-aab0-bdd3dea8b90c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:27.987004 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5ed82658-3d3e-4d16-ae9f-1416ccfedbb3 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:27.999309 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5ed82658-3d3e-4d16-ae9f-1416ccfedbb3 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1318 microversion: 2.1 time: 0.355777 Jan 17 21:22:28.000725 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 144/292] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:27 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:28.219615 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-2319567b-c4ea-41b0-98d3-b4eccb9e8d45 req-11152076-9f6c-4331-b5f9-3f48b4fb5ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f42f468d-0e69-47eb-8377-a1166c53c6e3", "tag": "c6bb9040-4ade-4ba5-a0a2-6bebb1713faf"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:28.221515 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:22:28.221515 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:22:28.224327 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-80151f0d-e04b-421f-aab0-bdd3dea8b90c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:28.235946 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-80151f0d-e04b-421f-aab0-bdd3dea8b90c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1508 microversion: 2.1 time: 0.326282 Jan 17 21:22:28.236867 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 149/293] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:27 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1508 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:28.244691 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-2319567b-c4ea-41b0-98d3-b4eccb9e8d45 req-11152076-9f6c-4331-b5f9-3f48b4fb5ab0 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:28.246092 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-2319567b-c4ea-41b0-98d3-b4eccb9e8d45 req-11152076-9f6c-4331-b5f9-3f48b4fb5ab0 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:28.267904 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7c8309f6-b09f-45cc-a821-8d2515dcc786 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:28.268547 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7c8309f6-b09f-45cc-a821-8d2515dcc786 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:28.270815 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-2319567b-c4ea-41b0-98d3-b4eccb9e8d45 req-11152076-9f6c-4331-b5f9-3f48b4fb5ab0 service nova] Creating event network-changed:c6bb9040-4ade-4ba5-a0a2-6bebb1713faf for instance f42f468d-0e69-47eb-8377-a1166c53c6e3 on hv-cinder-82489 Jan 17 21:22:28.279712 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7c8309f6-b09f-45cc-a821-8d2515dcc786 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:28.283622 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-2319567b-c4ea-41b0-98d3-b4eccb9e8d45 req-11152076-9f6c-4331-b5f9-3f48b4fb5ab0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071015 Jan 17 21:22:28.284279 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7c8309f6-b09f-45cc-a821-8d2515dcc786 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:28.284446 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 145/294] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:22:28.287442 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7c8309f6-b09f-45cc-a821-8d2515dcc786 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:28.288166 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7c8309f6-b09f-45cc-a821-8d2515dcc786 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:28.519329 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7c8309f6-b09f-45cc-a821-8d2515dcc786 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:28.528595 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7c8309f6-b09f-45cc-a821-8d2515dcc786 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1313 microversion: 2.1 time: 0.264743 Jan 17 21:22:28.529747 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 150/295] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:28 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:29.018616 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f8459b16-f9b4-4706-9d60-58e4fac8eab6 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:29.019505 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f8459b16-f9b4-4706-9d60-58e4fac8eab6 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:29.027384 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f8459b16-f9b4-4706-9d60-58e4fac8eab6 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:29.028354 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f8459b16-f9b4-4706-9d60-58e4fac8eab6 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:29.029430 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f8459b16-f9b4-4706-9d60-58e4fac8eab6 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:29.030067 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f8459b16-f9b4-4706-9d60-58e4fac8eab6 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:29.205543 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f8459b16-f9b4-4706-9d60-58e4fac8eab6 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:29.215833 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f8459b16-f9b4-4706-9d60-58e4fac8eab6 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1318 microversion: 2.1 time: 0.201501 Jan 17 21:22:29.216440 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 146/296] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:29 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:29.252791 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-615cb79f-4e9e-429e-a842-39d0db9a9485 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:29.253398 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-615cb79f-4e9e-429e-a842-39d0db9a9485 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:29.264891 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-615cb79f-4e9e-429e-a842-39d0db9a9485 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:29.265316 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-615cb79f-4e9e-429e-a842-39d0db9a9485 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:29.266167 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-615cb79f-4e9e-429e-a842-39d0db9a9485 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:29.266599 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-615cb79f-4e9e-429e-a842-39d0db9a9485 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:29.437884 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-615cb79f-4e9e-429e-a842-39d0db9a9485 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:29.446195 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-615cb79f-4e9e-429e-a842-39d0db9a9485 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1514 microversion: 2.1 time: 0.196942 Jan 17 21:22:29.446920 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 151/297] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:29 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:29.547686 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f5e019bc-11e5-4eb5-b648-9533c20869f5 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:29.549144 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f5e019bc-11e5-4eb5-b648-9533c20869f5 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:29.558138 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f5e019bc-11e5-4eb5-b648-9533c20869f5 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:29.558846 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f5e019bc-11e5-4eb5-b648-9533c20869f5 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:29.559642 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f5e019bc-11e5-4eb5-b648-9533c20869f5 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:29.560234 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f5e019bc-11e5-4eb5-b648-9533c20869f5 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:29.708523 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f5e019bc-11e5-4eb5-b648-9533c20869f5 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:29.718630 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f5e019bc-11e5-4eb5-b648-9533c20869f5 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1313 microversion: 2.1 time: 0.175575 Jan 17 21:22:29.719403 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 147/298] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:29 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:30.234413 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-185b9d84-5166-426a-8477-1c9ecf52da27 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:30.235133 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-185b9d84-5166-426a-8477-1c9ecf52da27 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:30.241434 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-185b9d84-5166-426a-8477-1c9ecf52da27 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:30.241883 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-185b9d84-5166-426a-8477-1c9ecf52da27 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:30.242731 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-185b9d84-5166-426a-8477-1c9ecf52da27 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:30.243239 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-185b9d84-5166-426a-8477-1c9ecf52da27 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:30.430075 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-185b9d84-5166-426a-8477-1c9ecf52da27 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:30.437760 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-185b9d84-5166-426a-8477-1c9ecf52da27 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1318 microversion: 2.1 time: 0.207650 Jan 17 21:22:30.438333 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 152/299] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:30 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:30.736688 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6ff8a785-1da7-42ed-98dd-70bafdf20ff3 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:30.737394 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6ff8a785-1da7-42ed-98dd-70bafdf20ff3 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:30.746160 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6ff8a785-1da7-42ed-98dd-70bafdf20ff3 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:30.746616 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6ff8a785-1da7-42ed-98dd-70bafdf20ff3 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:30.747769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6ff8a785-1da7-42ed-98dd-70bafdf20ff3 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:30.748219 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6ff8a785-1da7-42ed-98dd-70bafdf20ff3 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:30.930888 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6ff8a785-1da7-42ed-98dd-70bafdf20ff3 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:30.942018 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6ff8a785-1da7-42ed-98dd-70bafdf20ff3 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1313 microversion: 2.1 time: 0.209032 Jan 17 21:22:30.943527 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 148/300] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:30 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:31.094419 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1816831926", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452", "networks": [{"uuid": "90270886-8b72-4996-b451-52316e1bfe26"}]}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:31.143141 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.network.neutron [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] validate_networks() for [('90270886-8b72-4996-b451-52316e1bfe26', None, None, None, None, None)] {{(pid=116183) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:22:31.455797 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c116a73c-2d67-4b3f-90d0-fec83fe87d00 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:31.457140 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c116a73c-2d67-4b3f-90d0-fec83fe87d00 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:31.464306 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c116a73c-2d67-4b3f-90d0-fec83fe87d00 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:31.464983 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c116a73c-2d67-4b3f-90d0-fec83fe87d00 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:31.465818 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c116a73c-2d67-4b3f-90d0-fec83fe87d00 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:31.467040 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c116a73c-2d67-4b3f-90d0-fec83fe87d00 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:31.566745 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Flavor limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:22:31.567243 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Image limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:22:31.567650 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Flavor pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:22:31.568647 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Image pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:22:31.569237 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:22:31.580940 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:31.581432 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:31.582196 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:31.582636 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:31.608801 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Getting quotas for project 28496391913444ba9a1f04ca404c2c68. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:22:31.616407 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Getting quotas for user 5cfa3e62e8f64305a304058e9704ef23 and project 28496391913444ba9a1f04ca404c2c68. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:22:31.630449 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Going to run 1 instances... {{(pid=116183) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:22:31.633006 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:22:31.665024 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c116a73c-2d67-4b3f-90d0-fec83fe87d00 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:31.673903 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c116a73c-2d67-4b3f-90d0-fec83fe87d00 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1318 microversion: 2.1 time: 0.222601 Jan 17 21:22:31.674766 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 149/301] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:31 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:31.691462 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b3c07b04-c5ec-4dc2-abc3-64fdda359758 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600659 Jan 17 21:22:31.697073 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 153/302] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:22:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:22:31.702039 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-62155096-a18b-47b2-b500-94b2f991cb81 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:31.702650 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-62155096-a18b-47b2-b500-94b2f991cb81 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:31.767621 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-62155096-a18b-47b2-b500-94b2f991cb81 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:31.775076 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-62155096-a18b-47b2-b500-94b2f991cb81 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1218 microversion: 2.1 time: 0.076605 Jan 17 21:22:31.775810 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 150/303] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:31 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:31.910852 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-485299a0-fbba-4019-9e75-06d49032fb2a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:31.912205 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-485299a0-fbba-4019-9e75-06d49032fb2a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:31.918972 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-485299a0-fbba-4019-9e75-06d49032fb2a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:31.919774 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-485299a0-fbba-4019-9e75-06d49032fb2a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:31.920789 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-485299a0-fbba-4019-9e75-06d49032fb2a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:31.921837 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-485299a0-fbba-4019-9e75-06d49032fb2a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:31.968574 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e56c4129-4ccd-4d9f-a1b7-41926198e9dc tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:31.969697 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e56c4129-4ccd-4d9f-a1b7-41926198e9dc tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:31.976420 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e56c4129-4ccd-4d9f-a1b7-41926198e9dc tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:31.977226 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e56c4129-4ccd-4d9f-a1b7-41926198e9dc tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:31.978231 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e56c4129-4ccd-4d9f-a1b7-41926198e9dc tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:31.978877 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e56c4129-4ccd-4d9f-a1b7-41926198e9dc tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:32.115484 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-485299a0-fbba-4019-9e75-06d49032fb2a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:32.124128 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-485299a0-fbba-4019-9e75-06d49032fb2a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1514 microversion: 2.1 time: 0.216830 Jan 17 21:22:32.125314 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 154/304] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:31 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:32.141693 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ea358d80-455b-4410-9728-420b5fe839fe tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9519e024-8d11-4162-a4f0-1cec8afd9f45"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:32.143251 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ea358d80-455b-4410-9728-420b5fe839fe tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:32.152184 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ea358d80-455b-4410-9728-420b5fe839fe tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:32.152914 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ea358d80-455b-4410-9728-420b5fe839fe tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:32.153728 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ea358d80-455b-4410-9728-420b5fe839fe tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:32.154489 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ea358d80-455b-4410-9728-420b5fe839fe tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:32.215981 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-e56c4129-4ccd-4d9f-a1b7-41926198e9dc tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:32.224506 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e56c4129-4ccd-4d9f-a1b7-41926198e9dc tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1313 microversion: 2.1 time: 0.267705 Jan 17 21:22:32.225074 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 151/305] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:31 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:32.477326 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ea358d80-455b-4410-9728-420b5fe839fe tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "POST /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338438 Jan 17 21:22:32.478343 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 155/306] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jan 17 21:22:32 2022] POST /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:32.690648 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-57bad90b-db5a-483b-8cca-fc82d6bebbad tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:32.691267 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-57bad90b-db5a-483b-8cca-fc82d6bebbad tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:32.708788 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-57bad90b-db5a-483b-8cca-fc82d6bebbad tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:32.709705 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-57bad90b-db5a-483b-8cca-fc82d6bebbad tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:32.710942 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-57bad90b-db5a-483b-8cca-fc82d6bebbad tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:32.711778 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-57bad90b-db5a-483b-8cca-fc82d6bebbad tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:32.807993 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b46fe285-bebd-4c5f-b76c-d5d805baf842 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:32.808764 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b46fe285-bebd-4c5f-b76c-d5d805baf842 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:32.820068 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b46fe285-bebd-4c5f-b76c-d5d805baf842 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:32.820800 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b46fe285-bebd-4c5f-b76c-d5d805baf842 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:32.821811 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b46fe285-bebd-4c5f-b76c-d5d805baf842 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:32.822397 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b46fe285-bebd-4c5f-b76c-d5d805baf842 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:32.911333 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-57bad90b-db5a-483b-8cca-fc82d6bebbad tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:32.919216 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-57bad90b-db5a-483b-8cca-fc82d6bebbad tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1318 microversion: 2.1 time: 0.231979 Jan 17 21:22:32.920415 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 152/307] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:32 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:32.926223 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b46fe285-bebd-4c5f-b76c-d5d805baf842 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:32.935339 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b46fe285-bebd-4c5f-b76c-d5d805baf842 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1278 microversion: 2.1 time: 0.144243 Jan 17 21:22:32.936358 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 156/308] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:32 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1278 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:33.242346 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-de4b93c2-db6c-4816-ad33-ace58d41c611 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:33.243675 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-de4b93c2-db6c-4816-ad33-ace58d41c611 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:33.250437 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-de4b93c2-db6c-4816-ad33-ace58d41c611 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:33.251124 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-de4b93c2-db6c-4816-ad33-ace58d41c611 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:33.252104 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-de4b93c2-db6c-4816-ad33-ace58d41c611 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:33.252757 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-de4b93c2-db6c-4816-ad33-ace58d41c611 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:33.462840 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-de4b93c2-db6c-4816-ad33-ace58d41c611 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:33.480315 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-de4b93c2-db6c-4816-ad33-ace58d41c611 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1313 microversion: 2.1 time: 0.242705 Jan 17 21:22:33.480937 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 153/309] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:33 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:33.935775 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5eaa6615-1357-492c-82ff-5910bfe95515 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:33.936410 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5eaa6615-1357-492c-82ff-5910bfe95515 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:33.943814 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5eaa6615-1357-492c-82ff-5910bfe95515 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:33.944279 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5eaa6615-1357-492c-82ff-5910bfe95515 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:33.945112 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5eaa6615-1357-492c-82ff-5910bfe95515 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:33.945727 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5eaa6615-1357-492c-82ff-5910bfe95515 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:33.955035 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-35642952-eb16-47ac-a69d-27fbfdee50fa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:33.955798 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-35642952-eb16-47ac-a69d-27fbfdee50fa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:33.969332 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35642952-eb16-47ac-a69d-27fbfdee50fa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:33.970084 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35642952-eb16-47ac-a69d-27fbfdee50fa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:33.971096 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35642952-eb16-47ac-a69d-27fbfdee50fa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:33.971715 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35642952-eb16-47ac-a69d-27fbfdee50fa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:34.242079 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5eaa6615-1357-492c-82ff-5910bfe95515 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:34.251367 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5eaa6615-1357-492c-82ff-5910bfe95515 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1318 microversion: 2.1 time: 0.319104 Jan 17 21:22:34.253695 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 157/310] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:33 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:34.278649 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-35642952-eb16-47ac-a69d-27fbfdee50fa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:34.287700 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-35642952-eb16-47ac-a69d-27fbfdee50fa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1318 microversion: 2.1 time: 0.338403 Jan 17 21:22:34.289971 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 154/311] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:33 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:34.308208 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-3e740f43-b807-48ec-8c4f-57f95bc4d9c7 req-f27edc0c-7428-42c8-803e-f84580548ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40eba319-215c-4ff7-be04-20cb0d8d26ee", "tag": "687390ab-d9b1-43f0-800b-6bcd99484876"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:34.310162 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:22:34.310162 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:22:34.325510 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-3e740f43-b807-48ec-8c4f-57f95bc4d9c7 req-f27edc0c-7428-42c8-803e-f84580548ed9 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:34.325958 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-3e740f43-b807-48ec-8c4f-57f95bc4d9c7 req-f27edc0c-7428-42c8-803e-f84580548ed9 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:34.345893 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-3e740f43-b807-48ec-8c4f-57f95bc4d9c7 req-f27edc0c-7428-42c8-803e-f84580548ed9 service nova] Creating event network-changed:687390ab-d9b1-43f0-800b-6bcd99484876 for instance 40eba319-215c-4ff7-be04-20cb0d8d26ee on hv-cinder-82489 Jan 17 21:22:34.354066 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-3e740f43-b807-48ec-8c4f-57f95bc4d9c7 req-f27edc0c-7428-42c8-803e-f84580548ed9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050054 Jan 17 21:22:34.355600 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 158/312] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:22:34.497450 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c8a757f0-aa6c-4802-a26f-6a5ac7f56305 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:34.498060 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c8a757f0-aa6c-4802-a26f-6a5ac7f56305 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:34.506915 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c8a757f0-aa6c-4802-a26f-6a5ac7f56305 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:34.507376 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c8a757f0-aa6c-4802-a26f-6a5ac7f56305 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:34.508173 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c8a757f0-aa6c-4802-a26f-6a5ac7f56305 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:34.508632 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c8a757f0-aa6c-4802-a26f-6a5ac7f56305 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:34.671788 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c8a757f0-aa6c-4802-a26f-6a5ac7f56305 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:34.685946 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c8a757f0-aa6c-4802-a26f-6a5ac7f56305 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1313 microversion: 2.1 time: 0.192014 Jan 17 21:22:34.686455 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 155/313] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:34 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:35.271654 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9bfd94f7-b25c-4c1a-9af4-cc1c112de7a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:35.272354 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-9bfd94f7-b25c-4c1a-9af4-cc1c112de7a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:35.279811 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9bfd94f7-b25c-4c1a-9af4-cc1c112de7a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:35.280274 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9bfd94f7-b25c-4c1a-9af4-cc1c112de7a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:35.281130 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9bfd94f7-b25c-4c1a-9af4-cc1c112de7a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:35.281570 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9bfd94f7-b25c-4c1a-9af4-cc1c112de7a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:35.306368 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6be9077e-9911-433c-9cc9-bc801d247cfe tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:35.307692 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6be9077e-9911-433c-9cc9-bc801d247cfe tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:35.318440 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6be9077e-9911-433c-9cc9-bc801d247cfe tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:35.318899 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6be9077e-9911-433c-9cc9-bc801d247cfe tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:35.327932 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6be9077e-9911-433c-9cc9-bc801d247cfe tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:35.328554 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6be9077e-9911-433c-9cc9-bc801d247cfe tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:35.569928 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6be9077e-9911-433c-9cc9-bc801d247cfe tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:35.577327 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6be9077e-9911-433c-9cc9-bc801d247cfe tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1318 microversion: 2.1 time: 0.275933 Jan 17 21:22:35.581970 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-9bfd94f7-b25c-4c1a-9af4-cc1c112de7a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:35.586535 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 156/314] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:35 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:35.590276 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-9bfd94f7-b25c-4c1a-9af4-cc1c112de7a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1318 microversion: 2.1 time: 0.322775 Jan 17 21:22:35.591028 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 159/315] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:35 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:35.703086 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f64dffc2-35db-43b1-b39f-c58ce4425a64 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:35.703843 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f64dffc2-35db-43b1-b39f-c58ce4425a64 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:35.711289 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f64dffc2-35db-43b1-b39f-c58ce4425a64 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:35.711835 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f64dffc2-35db-43b1-b39f-c58ce4425a64 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:35.712949 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f64dffc2-35db-43b1-b39f-c58ce4425a64 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:35.713482 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f64dffc2-35db-43b1-b39f-c58ce4425a64 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:35.857930 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f64dffc2-35db-43b1-b39f-c58ce4425a64 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:35.865481 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f64dffc2-35db-43b1-b39f-c58ce4425a64 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1313 microversion: 2.1 time: 0.166164 Jan 17 21:22:35.866045 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 157/316] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:35 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:36.594194 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c2ee2e2c-2fee-4f45-a09b-1301221e0464 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:36.594924 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c2ee2e2c-2fee-4f45-a09b-1301221e0464 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:36.601257 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c2ee2e2c-2fee-4f45-a09b-1301221e0464 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:36.602029 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c2ee2e2c-2fee-4f45-a09b-1301221e0464 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:36.603297 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c2ee2e2c-2fee-4f45-a09b-1301221e0464 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:36.603925 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c2ee2e2c-2fee-4f45-a09b-1301221e0464 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:36.612528 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a242bba9-157c-4159-92ed-0a5376adc996 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:36.613780 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a242bba9-157c-4159-92ed-0a5376adc996 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:36.620983 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a242bba9-157c-4159-92ed-0a5376adc996 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:36.621662 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a242bba9-157c-4159-92ed-0a5376adc996 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:36.622765 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a242bba9-157c-4159-92ed-0a5376adc996 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:36.623421 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a242bba9-157c-4159-92ed-0a5376adc996 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:36.824229 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-c2ee2e2c-2fee-4f45-a09b-1301221e0464 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:36.833325 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c2ee2e2c-2fee-4f45-a09b-1301221e0464 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1318 microversion: 2.1 time: 0.242708 Jan 17 21:22:36.834523 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 160/317] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:36 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:36.837099 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a242bba9-157c-4159-92ed-0a5376adc996 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:36.847429 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a242bba9-157c-4159-92ed-0a5376adc996 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1318 microversion: 2.1 time: 0.238904 Jan 17 21:22:36.852859 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 158/318] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:36 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:36.881801 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ff6a4478-6bae-4685-8adb-8ed868497279 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:36.882403 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ff6a4478-6bae-4685-8adb-8ed868497279 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:36.888345 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ff6a4478-6bae-4685-8adb-8ed868497279 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:36.888818 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ff6a4478-6bae-4685-8adb-8ed868497279 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:36.889598 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ff6a4478-6bae-4685-8adb-8ed868497279 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:36.890027 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ff6a4478-6bae-4685-8adb-8ed868497279 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:37.042410 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ff6a4478-6bae-4685-8adb-8ed868497279 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:37.053078 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ff6a4478-6bae-4685-8adb-8ed868497279 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1313 microversion: 2.1 time: 0.172790 Jan 17 21:22:37.053078 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 161/319] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:36 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:37.851152 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-880220cb-4bf2-4c00-bb9d-e47c42f171b0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:37.851956 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-880220cb-4bf2-4c00-bb9d-e47c42f171b0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:37.858279 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-880220cb-4bf2-4c00-bb9d-e47c42f171b0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:37.858743 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-880220cb-4bf2-4c00-bb9d-e47c42f171b0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:37.859613 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-880220cb-4bf2-4c00-bb9d-e47c42f171b0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:37.860199 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-880220cb-4bf2-4c00-bb9d-e47c42f171b0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:37.865894 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-50b0f0db-e89e-47d9-bc83-cfc576d06343 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:37.866431 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-50b0f0db-e89e-47d9-bc83-cfc576d06343 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:37.873867 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-50b0f0db-e89e-47d9-bc83-cfc576d06343 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:37.874476 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-50b0f0db-e89e-47d9-bc83-cfc576d06343 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:37.875429 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-50b0f0db-e89e-47d9-bc83-cfc576d06343 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:37.875999 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-50b0f0db-e89e-47d9-bc83-cfc576d06343 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:38.235828 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-880220cb-4bf2-4c00-bb9d-e47c42f171b0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:38.247126 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-880220cb-4bf2-4c00-bb9d-e47c42f171b0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1318 microversion: 2.1 time: 0.399840 Jan 17 21:22:38.247958 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 159/320] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:37 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:38.252829 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7364f86a-2142-4d1f-8c0a-ece9886db899 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:38.253722 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7364f86a-2142-4d1f-8c0a-ece9886db899 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:38.261438 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7364f86a-2142-4d1f-8c0a-ece9886db899 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:38.262009 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7364f86a-2142-4d1f-8c0a-ece9886db899 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:38.263133 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7364f86a-2142-4d1f-8c0a-ece9886db899 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:38.264121 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7364f86a-2142-4d1f-8c0a-ece9886db899 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:38.266039 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-50b0f0db-e89e-47d9-bc83-cfc576d06343 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:38.278054 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-50b0f0db-e89e-47d9-bc83-cfc576d06343 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1318 microversion: 2.1 time: 0.416514 Jan 17 21:22:38.289343 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 162/321] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:37 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:38.294987 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-7e7c7a13-3bfe-46d2-a147-9ebc0bf902bd req-581d17bb-6c19-4679-a3b6-33f6aafc2035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42f468d-0e69-47eb-8377-a1166c53c6e3", "name": "network-vif-plugged", "status": "completed", "tag": "c6bb9040-4ade-4ba5-a0a2-6bebb1713faf"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:38.297338 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:22:38.297338 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:22:38.333803 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-7e7c7a13-3bfe-46d2-a147-9ebc0bf902bd req-581d17bb-6c19-4679-a3b6-33f6aafc2035 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:38.340151 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-7e7c7a13-3bfe-46d2-a147-9ebc0bf902bd req-581d17bb-6c19-4679-a3b6-33f6aafc2035 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:38.355613 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-7e7c7a13-3bfe-46d2-a147-9ebc0bf902bd req-581d17bb-6c19-4679-a3b6-33f6aafc2035 service nova] Creating event network-vif-plugged:c6bb9040-4ade-4ba5-a0a2-6bebb1713faf for instance f42f468d-0e69-47eb-8377-a1166c53c6e3 on hv-cinder-82489 Jan 17 21:22:38.369623 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-7e7c7a13-3bfe-46d2-a147-9ebc0bf902bd req-581d17bb-6c19-4679-a3b6-33f6aafc2035 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078105 Jan 17 21:22:38.370204 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 163/322] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:38.443435 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7364f86a-2142-4d1f-8c0a-ece9886db899 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:38.451961 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7364f86a-2142-4d1f-8c0a-ece9886db899 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1313 microversion: 2.1 time: 0.202779 Jan 17 21:22:38.452564 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 160/323] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:38 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:39.265101 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-09c3fe60-f815-4320-a9c7-11b85c97b8ff tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:39.265710 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-09c3fe60-f815-4320-a9c7-11b85c97b8ff tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:39.272720 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-09c3fe60-f815-4320-a9c7-11b85c97b8ff tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:39.273172 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-09c3fe60-f815-4320-a9c7-11b85c97b8ff tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:39.273961 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-09c3fe60-f815-4320-a9c7-11b85c97b8ff tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:39.274397 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-09c3fe60-f815-4320-a9c7-11b85c97b8ff tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:39.296146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-30709323-ae5d-43cf-9db5-ce21a7ca4c9a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:39.297073 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-30709323-ae5d-43cf-9db5-ce21a7ca4c9a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:39.305229 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-30709323-ae5d-43cf-9db5-ce21a7ca4c9a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:39.305685 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-30709323-ae5d-43cf-9db5-ce21a7ca4c9a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:39.306469 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-30709323-ae5d-43cf-9db5-ce21a7ca4c9a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:39.306907 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-30709323-ae5d-43cf-9db5-ce21a7ca4c9a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:39.490239 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-09c3fe60-f815-4320-a9c7-11b85c97b8ff tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:39.493417 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-30709323-ae5d-43cf-9db5-ce21a7ca4c9a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:39.501261 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-30709323-ae5d-43cf-9db5-ce21a7ca4c9a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1318 microversion: 2.1 time: 0.209768 Jan 17 21:22:39.501544 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-09c3fe60-f815-4320-a9c7-11b85c97b8ff tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1318 microversion: 2.1 time: 0.240247 Jan 17 21:22:39.501838 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 161/324] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:39 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:39.511596 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 164/325] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:39 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:39.515137 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c0fafec4-f27e-4cd3-a7ef-dec8f70307b1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:39.515243 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c0fafec4-f27e-4cd3-a7ef-dec8f70307b1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:39.522157 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c0fafec4-f27e-4cd3-a7ef-dec8f70307b1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:39.522612 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c0fafec4-f27e-4cd3-a7ef-dec8f70307b1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:39.523392 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c0fafec4-f27e-4cd3-a7ef-dec8f70307b1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:39.524438 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c0fafec4-f27e-4cd3-a7ef-dec8f70307b1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:39.660879 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c0fafec4-f27e-4cd3-a7ef-dec8f70307b1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:39.669325 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c0fafec4-f27e-4cd3-a7ef-dec8f70307b1 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1313 microversion: 2.1 time: 0.166309 Jan 17 21:22:39.669899 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 162/326] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:39 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:40.385964 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-0ee8b675-58c7-4e63-8b7f-ec8917d055bd req-5b05a042-f512-471a-bf9e-dd1d53f52513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6ecab4-ad67-494d-8290-50992425966f", "name": "network-vif-plugged", "status": "completed", "tag": "0f32a145-2070-4f51-b7d2-0671cb8e4109"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:40.387482 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:22:40.387482 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:22:40.394665 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-0ee8b675-58c7-4e63-8b7f-ec8917d055bd req-5b05a042-f512-471a-bf9e-dd1d53f52513 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:40.395104 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-0ee8b675-58c7-4e63-8b7f-ec8917d055bd req-5b05a042-f512-471a-bf9e-dd1d53f52513 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:40.405240 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-0ee8b675-58c7-4e63-8b7f-ec8917d055bd req-5b05a042-f512-471a-bf9e-dd1d53f52513 service nova] Creating event network-vif-plugged:0f32a145-2070-4f51-b7d2-0671cb8e4109 for instance 1a6ecab4-ad67-494d-8290-50992425966f on hv-cinder-82489 Jan 17 21:22:40.409800 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-0ee8b675-58c7-4e63-8b7f-ec8917d055bd req-5b05a042-f512-471a-bf9e-dd1d53f52513 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027507 Jan 17 21:22:40.410359 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 165/327] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:40.518979 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2654c8e5-9014-4207-844c-ce9bf8c289ca tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:40.520420 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2654c8e5-9014-4207-844c-ce9bf8c289ca tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:40.524628 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ef3f29e0-cebe-4f93-bb94-e5b8cc5b1dfd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:40.525649 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ef3f29e0-cebe-4f93-bb94-e5b8cc5b1dfd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:40.527821 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2654c8e5-9014-4207-844c-ce9bf8c289ca tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:40.528276 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2654c8e5-9014-4207-844c-ce9bf8c289ca tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:40.529101 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2654c8e5-9014-4207-844c-ce9bf8c289ca tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:40.529543 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2654c8e5-9014-4207-844c-ce9bf8c289ca tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:40.535744 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ef3f29e0-cebe-4f93-bb94-e5b8cc5b1dfd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:40.537441 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ef3f29e0-cebe-4f93-bb94-e5b8cc5b1dfd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:40.538468 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ef3f29e0-cebe-4f93-bb94-e5b8cc5b1dfd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:40.539021 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ef3f29e0-cebe-4f93-bb94-e5b8cc5b1dfd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:40.739763 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2654c8e5-9014-4207-844c-ce9bf8c289ca tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:40.743156 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ef3f29e0-cebe-4f93-bb94-e5b8cc5b1dfd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:40.749756 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2654c8e5-9014-4207-844c-ce9bf8c289ca tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1318 microversion: 2.1 time: 0.234957 Jan 17 21:22:40.750337 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 163/328] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:40 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:40.759769 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ef3f29e0-cebe-4f93-bb94-e5b8cc5b1dfd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1318 microversion: 2.1 time: 0.234529 Jan 17 21:22:40.759769 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 166/329] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:40 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:40.760927 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-596067138", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:40.764961 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0725b1a2-ae1f-49ad-85f2-641125eb02d4 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:40.765581 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0725b1a2-ae1f-49ad-85f2-641125eb02d4 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:40.773402 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0725b1a2-ae1f-49ad-85f2-641125eb02d4 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:40.773858 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0725b1a2-ae1f-49ad-85f2-641125eb02d4 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:40.774654 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0725b1a2-ae1f-49ad-85f2-641125eb02d4 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:40.775093 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0725b1a2-ae1f-49ad-85f2-641125eb02d4 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:40.815323 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.network.neutron [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] validate_networks() for None {{(pid=116183) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:22:41.100687 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-0725b1a2-ae1f-49ad-85f2-641125eb02d4 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:41.108808 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0725b1a2-ae1f-49ad-85f2-641125eb02d4 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1497 microversion: 2.1 time: 0.347529 Jan 17 21:22:41.109462 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 164/330] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:40 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1497 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:41.115855 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-95dd2a2d-50f1-4f5b-9370-cb80f4223def tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:41.117369 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-95dd2a2d-50f1-4f5b-9370-cb80f4223def tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:41.141960 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-95dd2a2d-50f1-4f5b-9370-cb80f4223def tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:41.142785 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-95dd2a2d-50f1-4f5b-9370-cb80f4223def tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:41.143885 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-95dd2a2d-50f1-4f5b-9370-cb80f4223def tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:41.144537 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-95dd2a2d-50f1-4f5b-9370-cb80f4223def tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:41.171299 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-95dd2a2d-50f1-4f5b-9370-cb80f4223def tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lazy-loading 'flavor' on Instance uuid 8a5818e4-0026-4597-9ef3-d539c2cdee97 {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:22:41.171520 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Flavor limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:22:41.171972 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Image limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:22:41.172466 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Flavor pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:22:41.173016 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Image pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:22:41.173515 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:22:41.183601 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:41.184059 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:41.184915 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:41.185367 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:41.202238 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Getting quotas for project bdc45770b23744f5bd0562e2a9210890. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:22:41.206621 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Getting quotas for user f1ebb65edde04b8194dcce87fe07bf62 and project bdc45770b23744f5bd0562e2a9210890. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:22:41.217929 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Going to run 1 instances... {{(pid=116183) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:22:41.220226 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:22:41.262871 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-aa61dd6b-a269-46c9-9a4a-08d3eabbcbb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510791 Jan 17 21:22:41.263875 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 167/331] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:22:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:22:41.273860 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7f3e62cf-e6ae-40f0-a255-d2a2acbd3218 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:41.274889 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7f3e62cf-e6ae-40f0-a255-d2a2acbd3218 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:41.309360 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-95dd2a2d-50f1-4f5b-9370-cb80f4223def tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "POST /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/action" status: 200 len: 32 microversion: 2.1 time: 0.198518 Jan 17 21:22:41.309955 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 165/332] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:22:41 2022] POST /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:22:41.330850 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f2fa02bd-12d0-4329-b78c-3bd75431f24f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:41.331503 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f2fa02bd-12d0-4329-b78c-3bd75431f24f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:41.340623 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f2fa02bd-12d0-4329-b78c-3bd75431f24f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:41.341187 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f2fa02bd-12d0-4329-b78c-3bd75431f24f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:41.342098 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f2fa02bd-12d0-4329-b78c-3bd75431f24f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:41.342601 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f2fa02bd-12d0-4329-b78c-3bd75431f24f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:41.355029 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7f3e62cf-e6ae-40f0-a255-d2a2acbd3218 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:41.362038 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7f3e62cf-e6ae-40f0-a255-d2a2acbd3218 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1214 microversion: 2.1 time: 0.092205 Jan 17 21:22:41.362614 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 168/333] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:41 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:41.525453 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f2fa02bd-12d0-4329-b78c-3bd75431f24f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:41.537060 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f2fa02bd-12d0-4329-b78c-3bd75431f24f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.214093 Jan 17 21:22:41.537899 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 166/334] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:41 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:41.638777 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-290ce28e-7041-4a2d-b8c2-6cabe9e0cf3f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:41.639268 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-290ce28e-7041-4a2d-b8c2-6cabe9e0cf3f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:41.647596 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-290ce28e-7041-4a2d-b8c2-6cabe9e0cf3f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:41.648058 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-290ce28e-7041-4a2d-b8c2-6cabe9e0cf3f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:41.648886 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-290ce28e-7041-4a2d-b8c2-6cabe9e0cf3f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:41.649509 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-290ce28e-7041-4a2d-b8c2-6cabe9e0cf3f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:41.678579 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-290ce28e-7041-4a2d-b8c2-6cabe9e0cf3f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Going to try to terminate instance {{(pid=116183) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:22:41.768154 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-99d33312-b0d9-42e1-9165-dc7e72687f6d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:41.769527 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-99d33312-b0d9-42e1-9165-dc7e72687f6d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:41.770130 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-290ce28e-7041-4a2d-b8c2-6cabe9e0cf3f tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 204 len: 0 microversion: 2.1 time: 0.134661 Jan 17 21:22:41.773157 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 169/335] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:22:41 2022] DELETE /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:22:41.781180 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99d33312-b0d9-42e1-9165-dc7e72687f6d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:41.782689 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6d21eab9-7fdc-4b27-a61a-ce11ce682574 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:41.783550 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6d21eab9-7fdc-4b27-a61a-ce11ce682574 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:41.787226 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99d33312-b0d9-42e1-9165-dc7e72687f6d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:41.788113 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99d33312-b0d9-42e1-9165-dc7e72687f6d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:41.788639 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99d33312-b0d9-42e1-9165-dc7e72687f6d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:41.791378 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6d21eab9-7fdc-4b27-a61a-ce11ce682574 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:41.791840 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6d21eab9-7fdc-4b27-a61a-ce11ce682574 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:41.793508 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6d21eab9-7fdc-4b27-a61a-ce11ce682574 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:41.793961 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6d21eab9-7fdc-4b27-a61a-ce11ce682574 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:42.036004 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6d21eab9-7fdc-4b27-a61a-ce11ce682574 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:42.051688 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6d21eab9-7fdc-4b27-a61a-ce11ce682574 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1318 microversion: 2.1 time: 0.276214 Jan 17 21:22:42.052904 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 170/336] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:41 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:42.061235 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1cf5d082-2816-40a3-aefa-36f5846b8669 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:42.062091 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1cf5d082-2816-40a3-aefa-36f5846b8669 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:42.064729 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-99d33312-b0d9-42e1-9165-dc7e72687f6d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:42.071034 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1cf5d082-2816-40a3-aefa-36f5846b8669 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:42.071881 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1cf5d082-2816-40a3-aefa-36f5846b8669 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:42.073011 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1cf5d082-2816-40a3-aefa-36f5846b8669 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:42.073131 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-99d33312-b0d9-42e1-9165-dc7e72687f6d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1318 microversion: 2.1 time: 0.308403 Jan 17 21:22:42.073701 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1cf5d082-2816-40a3-aefa-36f5846b8669 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:42.087581 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 167/337] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:41 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:42.234724 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1cf5d082-2816-40a3-aefa-36f5846b8669 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:42.242452 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1cf5d082-2816-40a3-aefa-36f5846b8669 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1503 microversion: 2.1 time: 0.188125 Jan 17 21:22:42.243022 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 171/338] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:42 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:42.397258 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-da9e83cd-68e7-4b80-b498-309cbafc83a6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:42.398024 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-da9e83cd-68e7-4b80-b498-309cbafc83a6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:42.404305 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-da9e83cd-68e7-4b80-b498-309cbafc83a6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:42.404879 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-da9e83cd-68e7-4b80-b498-309cbafc83a6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:42.405671 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-da9e83cd-68e7-4b80-b498-309cbafc83a6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:42.406114 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-da9e83cd-68e7-4b80-b498-309cbafc83a6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:42.467611 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-da9e83cd-68e7-4b80-b498-309cbafc83a6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:42.475146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-da9e83cd-68e7-4b80-b498-309cbafc83a6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1266 microversion: 2.1 time: 0.082243 Jan 17 21:22:42.475917 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 168/339] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:42 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:42.554947 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9d219c12-1784-497c-81d8-d7b16ff59b69 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:42.555554 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-9d219c12-1784-497c-81d8-d7b16ff59b69 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:42.561589 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9d219c12-1784-497c-81d8-d7b16ff59b69 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:42.562076 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9d219c12-1784-497c-81d8-d7b16ff59b69 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:42.562873 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9d219c12-1784-497c-81d8-d7b16ff59b69 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:42.563314 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9d219c12-1784-497c-81d8-d7b16ff59b69 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:42.707101 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-9d219c12-1784-497c-81d8-d7b16ff59b69 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:42.718205 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-9d219c12-1784-497c-81d8-d7b16ff59b69 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.167166 Jan 17 21:22:42.719190 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 172/340] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:42 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:43.069667 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-222a03b1-66f9-4f97-86f7-2fffb3cd8046 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:43.070287 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-222a03b1-66f9-4f97-86f7-2fffb3cd8046 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:43.077247 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-222a03b1-66f9-4f97-86f7-2fffb3cd8046 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:43.077779 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-222a03b1-66f9-4f97-86f7-2fffb3cd8046 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:43.078644 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-222a03b1-66f9-4f97-86f7-2fffb3cd8046 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:43.079187 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-222a03b1-66f9-4f97-86f7-2fffb3cd8046 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:43.091339 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-be62dece-6c77-42ee-9506-a9bc6d7b914c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:43.092491 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-be62dece-6c77-42ee-9506-a9bc6d7b914c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:43.099691 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-be62dece-6c77-42ee-9506-a9bc6d7b914c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:43.100144 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-be62dece-6c77-42ee-9506-a9bc6d7b914c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:43.101167 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-be62dece-6c77-42ee-9506-a9bc6d7b914c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:43.101784 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-be62dece-6c77-42ee-9506-a9bc6d7b914c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:43.323567 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-222a03b1-66f9-4f97-86f7-2fffb3cd8046 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:43.332047 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-222a03b1-66f9-4f97-86f7-2fffb3cd8046 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1318 microversion: 2.1 time: 0.266809 Jan 17 21:22:43.332844 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 169/341] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:43 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:43.337902 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-709aa0e7-1479-42e1-a433-e80d3e3faa16 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:43.338965 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-709aa0e7-1479-42e1-a433-e80d3e3faa16 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:43.344970 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-709aa0e7-1479-42e1-a433-e80d3e3faa16 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:43.345633 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-709aa0e7-1479-42e1-a433-e80d3e3faa16 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:43.349537 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-be62dece-6c77-42ee-9506-a9bc6d7b914c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:43.352285 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-709aa0e7-1479-42e1-a433-e80d3e3faa16 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:43.352763 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-709aa0e7-1479-42e1-a433-e80d3e3faa16 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:43.362093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-be62dece-6c77-42ee-9506-a9bc6d7b914c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1318 microversion: 2.1 time: 0.274572 Jan 17 21:22:43.362750 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 173/342] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:43 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:43.493550 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1d307057-d214-46bf-992d-89a845a150bd tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:43.494773 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1d307057-d214-46bf-992d-89a845a150bd tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:43.501421 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-709aa0e7-1479-42e1-a433-e80d3e3faa16 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:43.503905 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1d307057-d214-46bf-992d-89a845a150bd tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:43.507409 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1d307057-d214-46bf-992d-89a845a150bd tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:43.508857 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1d307057-d214-46bf-992d-89a845a150bd tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:43.510066 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1d307057-d214-46bf-992d-89a845a150bd tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:43.510776 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-709aa0e7-1479-42e1-a433-e80d3e3faa16 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1503 microversion: 2.1 time: 0.175845 Jan 17 21:22:43.511938 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 170/343] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:43 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:43.581462 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1d307057-d214-46bf-992d-89a845a150bd tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:43.590059 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1d307057-d214-46bf-992d-89a845a150bd tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1272 microversion: 2.1 time: 0.102058 Jan 17 21:22:43.590983 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 174/344] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:43 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:43.736286 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8f6ca60a-c598-4bea-9b9e-f4938aa66fd5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:43.736930 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8f6ca60a-c598-4bea-9b9e-f4938aa66fd5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:43.742881 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8f6ca60a-c598-4bea-9b9e-f4938aa66fd5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:43.743337 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8f6ca60a-c598-4bea-9b9e-f4938aa66fd5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:43.744119 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8f6ca60a-c598-4bea-9b9e-f4938aa66fd5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:43.744748 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8f6ca60a-c598-4bea-9b9e-f4938aa66fd5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:43.889150 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-8f6ca60a-c598-4bea-9b9e-f4938aa66fd5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:43.898194 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8f6ca60a-c598-4bea-9b9e-f4938aa66fd5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.165454 Jan 17 21:22:43.899113 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 171/345] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:43 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:44.290930 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-249e5ac1-cb7f-4875-b042-f08ae1b1198b req-f64f6fc6-352b-49c8-97ab-f5b69acdeddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40eba319-215c-4ff7-be04-20cb0d8d26ee", "name": "network-vif-plugged", "status": "completed", "tag": "687390ab-d9b1-43f0-800b-6bcd99484876"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:44.294479 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:22:44.294479 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:22:44.302842 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-249e5ac1-cb7f-4875-b042-f08ae1b1198b req-f64f6fc6-352b-49c8-97ab-f5b69acdeddc service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:44.303272 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-249e5ac1-cb7f-4875-b042-f08ae1b1198b req-f64f6fc6-352b-49c8-97ab-f5b69acdeddc service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:44.316401 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-249e5ac1-cb7f-4875-b042-f08ae1b1198b req-f64f6fc6-352b-49c8-97ab-f5b69acdeddc service nova] Creating event network-vif-plugged:687390ab-d9b1-43f0-800b-6bcd99484876 for instance 40eba319-215c-4ff7-be04-20cb0d8d26ee on hv-cinder-82489 Jan 17 21:22:44.321881 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-249e5ac1-cb7f-4875-b042-f08ae1b1198b req-f64f6fc6-352b-49c8-97ab-f5b69acdeddc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034532 Jan 17 21:22:44.322778 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 175/346] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:44.350546 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6d3c9ae9-be85-426e-bc83-0483b68ed6a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:44.351507 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6d3c9ae9-be85-426e-bc83-0483b68ed6a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:44.359846 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6d3c9ae9-be85-426e-bc83-0483b68ed6a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:44.360579 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6d3c9ae9-be85-426e-bc83-0483b68ed6a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:44.361704 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6d3c9ae9-be85-426e-bc83-0483b68ed6a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:44.362519 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6d3c9ae9-be85-426e-bc83-0483b68ed6a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:44.379301 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b070a03e-4606-4fad-bb89-93e8a9293279 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:44.380268 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b070a03e-4606-4fad-bb89-93e8a9293279 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:44.387925 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b070a03e-4606-4fad-bb89-93e8a9293279 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:44.388398 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b070a03e-4606-4fad-bb89-93e8a9293279 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:44.389193 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b070a03e-4606-4fad-bb89-93e8a9293279 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:44.389619 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b070a03e-4606-4fad-bb89-93e8a9293279 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:44.752787 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b070a03e-4606-4fad-bb89-93e8a9293279 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:44.761544 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b070a03e-4606-4fad-bb89-93e8a9293279 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1318 microversion: 2.1 time: 0.386196 Jan 17 21:22:44.762875 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 176/347] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:44 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:44.772816 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5cb012a1-9091-4aeb-a01e-02b122f23478 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:44.774340 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5cb012a1-9091-4aeb-a01e-02b122f23478 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:44.787192 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5cb012a1-9091-4aeb-a01e-02b122f23478 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:44.787651 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5cb012a1-9091-4aeb-a01e-02b122f23478 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:44.788502 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5cb012a1-9091-4aeb-a01e-02b122f23478 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:44.788946 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5cb012a1-9091-4aeb-a01e-02b122f23478 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:44.790180 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6d3c9ae9-be85-426e-bc83-0483b68ed6a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:44.802369 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6d3c9ae9-be85-426e-bc83-0483b68ed6a5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1506 microversion: 2.1 time: 0.456794 Jan 17 21:22:44.805898 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 172/348] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:44 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1506 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:44.810626 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f7c2fd0d-4186-447a-b5c9-88f132691643 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:44.811372 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f7c2fd0d-4186-447a-b5c9-88f132691643 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:44.820159 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f7c2fd0d-4186-447a-b5c9-88f132691643 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:44.824896 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f7c2fd0d-4186-447a-b5c9-88f132691643 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:44.825882 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f7c2fd0d-4186-447a-b5c9-88f132691643 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:44.826333 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f7c2fd0d-4186-447a-b5c9-88f132691643 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:45.214547 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5cb012a1-9091-4aeb-a01e-02b122f23478 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:45.221385 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5cb012a1-9091-4aeb-a01e-02b122f23478 tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1503 microversion: 2.1 time: 0.456351 Jan 17 21:22:45.222464 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 177/349] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:44 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1503 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:45.242748 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-c9dbd215-6ba2-487b-93ef-d16500f0cb53 req-89c74c80-8ab0-4cda-80da-04b032e7ad4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722796bd-49c1-4a74-9f3c-f9ea7863440c", "tag": "b7b6c108-ba5a-4fa7-98f2-021e2ac61686"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:45.245548 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f7c2fd0d-4186-447a-b5c9-88f132691643 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:45.255616 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f7c2fd0d-4186-447a-b5c9-88f132691643 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.446502 Jan 17 21:22:45.256211 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 173/350] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:44 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:45.269587 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-93756dd4-c615-4fa8-b332-8550ca173300 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:45.270181 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-93756dd4-c615-4fa8-b332-8550ca173300 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:45.275020 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:22:45.275020 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:22:45.289630 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-c9dbd215-6ba2-487b-93ef-d16500f0cb53 req-89c74c80-8ab0-4cda-80da-04b032e7ad4f service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:45.289630 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-c9dbd215-6ba2-487b-93ef-d16500f0cb53 req-89c74c80-8ab0-4cda-80da-04b032e7ad4f service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:45.304764 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-93756dd4-c615-4fa8-b332-8550ca173300 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:45.305208 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-93756dd4-c615-4fa8-b332-8550ca173300 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:45.309548 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-c9dbd215-6ba2-487b-93ef-d16500f0cb53 req-89c74c80-8ab0-4cda-80da-04b032e7ad4f service nova] Creating event network-changed:b7b6c108-ba5a-4fa7-98f2-021e2ac61686 for instance 722796bd-49c1-4a74-9f3c-f9ea7863440c on hv-cinder-82489 Jan 17 21:22:45.310581 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-93756dd4-c615-4fa8-b332-8550ca173300 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:45.312955 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-93756dd4-c615-4fa8-b332-8550ca173300 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:45.316034 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-c9dbd215-6ba2-487b-93ef-d16500f0cb53 req-89c74c80-8ab0-4cda-80da-04b032e7ad4f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092591 Jan 17 21:22:45.318271 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 178/351] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:45.785885 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-17dda2e6-1c02-445e-a899-c699a0a32831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:45.789341 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-17dda2e6-1c02-445e-a899-c699a0a32831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:45.798577 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17dda2e6-1c02-445e-a899-c699a0a32831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:45.799014 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17dda2e6-1c02-445e-a899-c699a0a32831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:45.800944 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17dda2e6-1c02-445e-a899-c699a0a32831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:45.802938 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17dda2e6-1c02-445e-a899-c699a0a32831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:45.907336 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-93756dd4-c615-4fa8-b332-8550ca173300 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:45.917280 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-93756dd4-c615-4fa8-b332-8550ca173300 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.651130 Jan 17 21:22:45.919860 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 174/352] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:45 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:45.924945 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-834acb94-9248-47d4-9082-78cdf103e772 req-a08fde80-6d98-4632-b5cf-df725875ff81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42f468d-0e69-47eb-8377-a1166c53c6e3", "name": "network-vif-deleted", "tag": "c6bb9040-4ade-4ba5-a0a2-6bebb1713faf"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:45.937099 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:22:45.937099 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:22:45.950426 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-834acb94-9248-47d4-9082-78cdf103e772 req-a08fde80-6d98-4632-b5cf-df725875ff81 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:45.950876 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-834acb94-9248-47d4-9082-78cdf103e772 req-a08fde80-6d98-4632-b5cf-df725875ff81 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:46.014722 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-834acb94-9248-47d4-9082-78cdf103e772 req-a08fde80-6d98-4632-b5cf-df725875ff81 service nova] Creating event network-vif-deleted:c6bb9040-4ade-4ba5-a0a2-6bebb1713faf for instance f42f468d-0e69-47eb-8377-a1166c53c6e3 on hv-cinder-82489 Jan 17 21:22:46.034151 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-17dda2e6-1c02-445e-a899-c699a0a32831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:46.035783 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-834acb94-9248-47d4-9082-78cdf103e772 req-a08fde80-6d98-4632-b5cf-df725875ff81 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112146 Jan 17 21:22:46.037805 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 175/353] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:46.047638 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-17dda2e6-1c02-445e-a899-c699a0a32831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1318 microversion: 2.1 time: 0.268299 Jan 17 21:22:46.049420 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 179/354] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:45 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:46.239766 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a4b527c1-fb47-4641-8308-341fdd82f48c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:46.240489 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a4b527c1-fb47-4641-8308-341fdd82f48c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:46.248092 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4b527c1-fb47-4641-8308-341fdd82f48c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:46.248740 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4b527c1-fb47-4641-8308-341fdd82f48c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:46.249902 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4b527c1-fb47-4641-8308-341fdd82f48c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:46.250342 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4b527c1-fb47-4641-8308-341fdd82f48c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:46.274649 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-786379b4-aa3b-4b40-95a3-c226a0c9c184 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:46.275402 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-786379b4-aa3b-4b40-95a3-c226a0c9c184 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:46.285969 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4b527c1-fb47-4641-8308-341fdd82f48c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:46.287210 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4b527c1-fb47-4641-8308-341fdd82f48c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:46.287912 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-a4b527c1-fb47-4641-8308-341fdd82f48c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lazy-loading 'fault' on Instance uuid f42f468d-0e69-47eb-8377-a1166c53c6e3 {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:22:46.312021 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-786379b4-aa3b-4b40-95a3-c226a0c9c184 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:46.313171 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-786379b4-aa3b-4b40-95a3-c226a0c9c184 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:46.314053 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-786379b4-aa3b-4b40-95a3-c226a0c9c184 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:46.314887 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-786379b4-aa3b-4b40-95a3-c226a0c9c184 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:46.345062 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a4b527c1-fb47-4641-8308-341fdd82f48c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab0163c5068748eb88921dd43dd762b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950cb12ecf9943fa811a11b8a46aeefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:46.357210 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a4b527c1-fb47-4641-8308-341fdd82f48c tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 200 len: 1303 microversion: 2.1 time: 0.118526 Jan 17 21:22:46.357210 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 176/355] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:46 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 1303 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:46.451727 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-786379b4-aa3b-4b40-95a3-c226a0c9c184 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:46.461776 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-786379b4-aa3b-4b40-95a3-c226a0c9c184 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.193001 Jan 17 21:22:46.462349 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 180/356] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:46 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:46.934582 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4f44327f-89a7-4e8d-8c37-3ffd520c55de tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:46.935189 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4f44327f-89a7-4e8d-8c37-3ffd520c55de tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:46.941601 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4f44327f-89a7-4e8d-8c37-3ffd520c55de tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:46.942050 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4f44327f-89a7-4e8d-8c37-3ffd520c55de tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:46.943459 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4f44327f-89a7-4e8d-8c37-3ffd520c55de tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:46.943896 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4f44327f-89a7-4e8d-8c37-3ffd520c55de tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:47.066700 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0b7d63c8-b33f-4d44-8c3f-bb628b55272a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:47.067970 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-0b7d63c8-b33f-4d44-8c3f-bb628b55272a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:47.073801 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0b7d63c8-b33f-4d44-8c3f-bb628b55272a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:47.074261 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0b7d63c8-b33f-4d44-8c3f-bb628b55272a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:47.075003 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4f44327f-89a7-4e8d-8c37-3ffd520c55de tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:47.075143 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0b7d63c8-b33f-4d44-8c3f-bb628b55272a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:47.075472 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0b7d63c8-b33f-4d44-8c3f-bb628b55272a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:47.082678 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4f44327f-89a7-4e8d-8c37-3ffd520c55de tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.151720 Jan 17 21:22:47.083242 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 177/357] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:46 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:47.207457 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-0b7d63c8-b33f-4d44-8c3f-bb628b55272a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:47.215129 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-0b7d63c8-b33f-4d44-8c3f-bb628b55272a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1508 microversion: 2.1 time: 0.152046 Jan 17 21:22:47.215696 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 181/358] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:47 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:47.231274 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8278f8d3-36af-4e4b-b855-c5a39f92daae tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "421af2cf-dfdc-4163-9ab3-483bc73791bb"}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:22:47.232995 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8278f8d3-36af-4e4b-b855-c5a39f92daae tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:47.238805 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8278f8d3-36af-4e4b-b855-c5a39f92daae tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:47.239783 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8278f8d3-36af-4e4b-b855-c5a39f92daae tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:47.240593 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8278f8d3-36af-4e4b-b855-c5a39f92daae tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:47.241030 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8278f8d3-36af-4e4b-b855-c5a39f92daae tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:47.316318 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-8278f8d3-36af-4e4b-b855-c5a39f92daae tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] HTTP exception thrown: Invalid volume: volume 421af2cf-dfdc-4163-9ab3-483bc73791bb is already attached to instances: 3de27f69-552a-4922-8576-4163c4c8bfb0 Jan 17 21:22:47.316971 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8278f8d3-36af-4e4b-b855-c5a39f92daae tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Returning 400 to user: Invalid volume: volume 421af2cf-dfdc-4163-9ab3-483bc73791bb is already attached to instances: 3de27f69-552a-4922-8576-4163c4c8bfb0 {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:22:47.317804 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8278f8d3-36af-4e4b-b855-c5a39f92daae tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "POST /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090321 Jan 17 21:22:47.318341 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 178/359] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jan 17 21:22:47 2022] POST /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 17 21:22:47.373042 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0d7fcab5-02de-439a-9872-279b51d67c0b tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:47.373657 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-0d7fcab5-02de-439a-9872-279b51d67c0b tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] [instance: f42f468d-0e69-47eb-8377-a1166c53c6e3] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:47.375386 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c9947bfe-38f2-435b-94b8-fdb920de8dbc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:47.376092 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c9947bfe-38f2-435b-94b8-fdb920de8dbc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:47.380220 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0d7fcab5-02de-439a-9872-279b51d67c0b tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:47.380723 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0d7fcab5-02de-439a-9872-279b51d67c0b tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:47.381576 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0d7fcab5-02de-439a-9872-279b51d67c0b tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:47.381952 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0d7fcab5-02de-439a-9872-279b51d67c0b tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:47.383343 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c9947bfe-38f2-435b-94b8-fdb920de8dbc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:47.383899 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c9947bfe-38f2-435b-94b8-fdb920de8dbc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:47.384833 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c9947bfe-38f2-435b-94b8-fdb920de8dbc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:47.385386 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c9947bfe-38f2-435b-94b8-fdb920de8dbc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:47.395540 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-0d7fcab5-02de-439a-9872-279b51d67c0b tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] HTTP exception thrown: Instance f42f468d-0e69-47eb-8377-a1166c53c6e3 could not be found. Jan 17 21:22:47.396211 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0d7fcab5-02de-439a-9872-279b51d67c0b tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] Returning 404 to user: Instance f42f468d-0e69-47eb-8377-a1166c53c6e3 could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:22:47.397074 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-0d7fcab5-02de-439a-9872-279b51d67c0b tempest-VolumesActionsTest-454871514 tempest-VolumesActionsTest-454871514-project] 10.222.0.64 "GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3" status: 404 len: 111 microversion: 2.1 time: 0.027682 Jan 17 21:22:47.397735 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 182/360] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:47 2022] GET /compute/v2.1/servers/f42f468d-0e69-47eb-8377-a1166c53c6e3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:22:47.479150 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3dd3c04e-d839-4de5-92f2-593600c1f0ef tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:47.480285 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3dd3c04e-d839-4de5-92f2-593600c1f0ef tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:47.486480 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3dd3c04e-d839-4de5-92f2-593600c1f0ef tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:47.487011 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3dd3c04e-d839-4de5-92f2-593600c1f0ef tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:47.487877 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3dd3c04e-d839-4de5-92f2-593600c1f0ef tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:47.488405 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3dd3c04e-d839-4de5-92f2-593600c1f0ef tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:47.515640 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-c9947bfe-38f2-435b-94b8-fdb920de8dbc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lazy-loading 'services' on Instance uuid 3de27f69-552a-4922-8576-4163c4c8bfb0 {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:22:47.644943 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3dd3c04e-d839-4de5-92f2-593600c1f0ef tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:47.650011 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c9947bfe-38f2-435b-94b8-fdb920de8dbc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments/421af2cf-dfdc-4163-9ab3-483bc73791bb" status: 202 len: 0 microversion: 2.1 time: 0.278295 Jan 17 21:22:47.650978 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 179/361] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jan 17 21:22:47 2022] DELETE /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments/421af2cf-dfdc-4163-9ab3-483bc73791bb => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:22:47.654760 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3dd3c04e-d839-4de5-92f2-593600c1f0ef tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.179226 Jan 17 21:22:47.655314 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 183/362] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:47 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:47.658989 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-188aa995-4f5d-4bfc-8edf-02c6baa2dc84 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:47.660253 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-188aa995-4f5d-4bfc-8edf-02c6baa2dc84 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:47.668078 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-188aa995-4f5d-4bfc-8edf-02c6baa2dc84 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:47.668736 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-188aa995-4f5d-4bfc-8edf-02c6baa2dc84 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:47.669523 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-188aa995-4f5d-4bfc-8edf-02c6baa2dc84 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:47.669960 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-188aa995-4f5d-4bfc-8edf-02c6baa2dc84 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:47.703438 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-188aa995-4f5d-4bfc-8edf-02c6baa2dc84 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048137 Jan 17 21:22:47.703995 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 180/363] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:22:47 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:48.098999 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-16f5e941-057b-45e0-8f3d-d79d993a0002 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:48.099612 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-16f5e941-057b-45e0-8f3d-d79d993a0002 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:48.105642 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-16f5e941-057b-45e0-8f3d-d79d993a0002 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:48.106184 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-16f5e941-057b-45e0-8f3d-d79d993a0002 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:48.107078 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-16f5e941-057b-45e0-8f3d-d79d993a0002 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:48.107568 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-16f5e941-057b-45e0-8f3d-d79d993a0002 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:48.250702 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-16f5e941-057b-45e0-8f3d-d79d993a0002 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:48.259253 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-16f5e941-057b-45e0-8f3d-d79d993a0002 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.164097 Jan 17 21:22:48.259814 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 184/364] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:48 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:48.671616 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-757f1062-0f88-42f4-8097-6f1973131a9e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:48.672224 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-757f1062-0f88-42f4-8097-6f1973131a9e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:48.679146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-757f1062-0f88-42f4-8097-6f1973131a9e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:48.679613 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-757f1062-0f88-42f4-8097-6f1973131a9e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:48.680400 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-757f1062-0f88-42f4-8097-6f1973131a9e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:48.680851 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-757f1062-0f88-42f4-8097-6f1973131a9e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:48.716203 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c6786978-5936-46fe-90ae-e30d0f94e12d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:48.717225 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c6786978-5936-46fe-90ae-e30d0f94e12d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:48.723676 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c6786978-5936-46fe-90ae-e30d0f94e12d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:48.724126 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c6786978-5936-46fe-90ae-e30d0f94e12d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:48.725056 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c6786978-5936-46fe-90ae-e30d0f94e12d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:48.725502 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c6786978-5936-46fe-90ae-e30d0f94e12d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:48.760140 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c6786978-5936-46fe-90ae-e30d0f94e12d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047558 Jan 17 21:22:48.761882 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 185/365] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:22:48 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:22:48.813246 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-757f1062-0f88-42f4-8097-6f1973131a9e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:48.820544 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-757f1062-0f88-42f4-8097-6f1973131a9e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.153188 Jan 17 21:22:48.821105 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 181/366] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:48 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:49.276731 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e8ab6f5e-f078-4039-bf29-4202a8eae107 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:49.277254 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-e8ab6f5e-f078-4039-bf29-4202a8eae107 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:49.283116 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e8ab6f5e-f078-4039-bf29-4202a8eae107 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:49.283576 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e8ab6f5e-f078-4039-bf29-4202a8eae107 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:49.284358 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e8ab6f5e-f078-4039-bf29-4202a8eae107 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:49.284827 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e8ab6f5e-f078-4039-bf29-4202a8eae107 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:49.412001 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-e8ab6f5e-f078-4039-bf29-4202a8eae107 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:49.419770 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e8ab6f5e-f078-4039-bf29-4202a8eae107 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.146799 Jan 17 21:22:49.420333 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 186/367] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:49 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:49.772308 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-754e15cf-8743-47fb-b824-19cb68261316 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:49.773241 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-754e15cf-8743-47fb-b824-19cb68261316 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:49.779420 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-754e15cf-8743-47fb-b824-19cb68261316 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:49.779869 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-754e15cf-8743-47fb-b824-19cb68261316 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:49.780695 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-754e15cf-8743-47fb-b824-19cb68261316 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:49.781143 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-754e15cf-8743-47fb-b824-19cb68261316 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:49.809066 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-754e15cf-8743-47fb-b824-19cb68261316 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041140 Jan 17 21:22:49.809614 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 182/368] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:22:49 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:49.838866 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ce0f1b88-0b76-4307-9561-c6170baa379a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:49.839751 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ce0f1b88-0b76-4307-9561-c6170baa379a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:49.847359 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ce0f1b88-0b76-4307-9561-c6170baa379a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:49.847923 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ce0f1b88-0b76-4307-9561-c6170baa379a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:49.849119 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ce0f1b88-0b76-4307-9561-c6170baa379a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:49.849648 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ce0f1b88-0b76-4307-9561-c6170baa379a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:49.981766 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ce0f1b88-0b76-4307-9561-c6170baa379a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:49.989467 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ce0f1b88-0b76-4307-9561-c6170baa379a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.154641 Jan 17 21:22:49.990019 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 187/369] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:49 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:50.436940 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-05422cdd-186a-44f5-b530-992cf7ee5dc2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:50.437470 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-05422cdd-186a-44f5-b530-992cf7ee5dc2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:50.443347 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-05422cdd-186a-44f5-b530-992cf7ee5dc2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:50.443793 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-05422cdd-186a-44f5-b530-992cf7ee5dc2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:50.444602 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-05422cdd-186a-44f5-b530-992cf7ee5dc2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:50.445033 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-05422cdd-186a-44f5-b530-992cf7ee5dc2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:50.575339 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-05422cdd-186a-44f5-b530-992cf7ee5dc2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:50.583270 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-05422cdd-186a-44f5-b530-992cf7ee5dc2 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.150049 Jan 17 21:22:50.583825 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 183/370] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:50 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:50.820718 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-438f152e-ab4e-426f-a750-af4f7bc2df17 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:50.821673 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-438f152e-ab4e-426f-a750-af4f7bc2df17 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:50.827529 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-438f152e-ab4e-426f-a750-af4f7bc2df17 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:50.827980 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-438f152e-ab4e-426f-a750-af4f7bc2df17 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:50.828794 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-438f152e-ab4e-426f-a750-af4f7bc2df17 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:50.829262 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-438f152e-ab4e-426f-a750-af4f7bc2df17 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:50.860040 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-438f152e-ab4e-426f-a750-af4f7bc2df17 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043434 Jan 17 21:22:50.860688 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 188/371] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:22:50 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:51.007478 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2dd71e3e-e2a2-4b75-9770-6b81851be97d tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:51.008098 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2dd71e3e-e2a2-4b75-9770-6b81851be97d tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:51.017123 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2dd71e3e-e2a2-4b75-9770-6b81851be97d tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:51.017578 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2dd71e3e-e2a2-4b75-9770-6b81851be97d tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:51.018377 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2dd71e3e-e2a2-4b75-9770-6b81851be97d tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:51.018817 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2dd71e3e-e2a2-4b75-9770-6b81851be97d tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:51.153391 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2dd71e3e-e2a2-4b75-9770-6b81851be97d tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:51.160654 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2dd71e3e-e2a2-4b75-9770-6b81851be97d tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.157358 Jan 17 21:22:51.161213 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 184/372] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:51 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:51.600068 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ee0ddd49-4d61-4245-b20e-34d215c1384c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:51.600711 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ee0ddd49-4d61-4245-b20e-34d215c1384c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:51.606577 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ee0ddd49-4d61-4245-b20e-34d215c1384c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:51.607036 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ee0ddd49-4d61-4245-b20e-34d215c1384c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:51.607819 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ee0ddd49-4d61-4245-b20e-34d215c1384c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:51.608472 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ee0ddd49-4d61-4245-b20e-34d215c1384c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:51.737551 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ee0ddd49-4d61-4245-b20e-34d215c1384c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:51.752394 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ee0ddd49-4d61-4245-b20e-34d215c1384c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.155679 Jan 17 21:22:51.753283 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 189/373] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:51 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:51.872691 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a40a1f72-90c7-4eb6-abf4-0f2c359b3e19 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:51.873655 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a40a1f72-90c7-4eb6-abf4-0f2c359b3e19 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:51.879674 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a40a1f72-90c7-4eb6-abf4-0f2c359b3e19 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:51.880130 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a40a1f72-90c7-4eb6-abf4-0f2c359b3e19 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:51.880945 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a40a1f72-90c7-4eb6-abf4-0f2c359b3e19 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:51.881391 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a40a1f72-90c7-4eb6-abf4-0f2c359b3e19 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:51.909219 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a40a1f72-90c7-4eb6-abf4-0f2c359b3e19 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040711 Jan 17 21:22:51.909772 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 185/374] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:22:51 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:52.177235 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d4efbe7a-2d49-4b1d-a793-1ac2758968b9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:52.177843 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d4efbe7a-2d49-4b1d-a793-1ac2758968b9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:52.184194 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4efbe7a-2d49-4b1d-a793-1ac2758968b9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:52.184696 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4efbe7a-2d49-4b1d-a793-1ac2758968b9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:52.185470 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4efbe7a-2d49-4b1d-a793-1ac2758968b9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:52.185916 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4efbe7a-2d49-4b1d-a793-1ac2758968b9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:52.325283 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-d4efbe7a-2d49-4b1d-a793-1ac2758968b9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:52.333019 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d4efbe7a-2d49-4b1d-a793-1ac2758968b9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.159049 Jan 17 21:22:52.333575 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 190/375] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:52 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:52.769751 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-12e2a039-20b4-4abe-b3dc-ea4e3b074673 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:52.770389 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-12e2a039-20b4-4abe-b3dc-ea4e3b074673 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:52.776703 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-12e2a039-20b4-4abe-b3dc-ea4e3b074673 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:52.777159 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-12e2a039-20b4-4abe-b3dc-ea4e3b074673 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:52.778000 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-12e2a039-20b4-4abe-b3dc-ea4e3b074673 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:52.778442 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-12e2a039-20b4-4abe-b3dc-ea4e3b074673 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:52.907881 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-12e2a039-20b4-4abe-b3dc-ea4e3b074673 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:52.916261 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-12e2a039-20b4-4abe-b3dc-ea4e3b074673 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.150161 Jan 17 21:22:52.916853 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 186/376] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:52 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:22:52.920982 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d85f93f4-60e4-4239-809e-757d13573665 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:52.921898 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d85f93f4-60e4-4239-809e-757d13573665 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:52.927601 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d85f93f4-60e4-4239-809e-757d13573665 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:52.928045 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d85f93f4-60e4-4239-809e-757d13573665 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:52.928847 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d85f93f4-60e4-4239-809e-757d13573665 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:52.929287 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d85f93f4-60e4-4239-809e-757d13573665 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:52.956613 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d85f93f4-60e4-4239-809e-757d13573665 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039314 Jan 17 21:22:52.957154 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 191/377] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:22:52 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:22:53.352503 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5480e766-8e1e-4a19-98b7-c578c32ba964 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:53.353118 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5480e766-8e1e-4a19-98b7-c578c32ba964 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:53.358916 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5480e766-8e1e-4a19-98b7-c578c32ba964 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:53.359368 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5480e766-8e1e-4a19-98b7-c578c32ba964 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:53.360146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5480e766-8e1e-4a19-98b7-c578c32ba964 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:53.360611 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5480e766-8e1e-4a19-98b7-c578c32ba964 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:53.489268 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5480e766-8e1e-4a19-98b7-c578c32ba964 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:53.496713 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5480e766-8e1e-4a19-98b7-c578c32ba964 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.147968 Jan 17 21:22:53.497281 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 187/378] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:53 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:53.932213 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4e466b17-9a57-4028-9d04-8f28f89c8d6f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:53.932853 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4e466b17-9a57-4028-9d04-8f28f89c8d6f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:53.939093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4e466b17-9a57-4028-9d04-8f28f89c8d6f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:53.939550 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4e466b17-9a57-4028-9d04-8f28f89c8d6f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:53.940329 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4e466b17-9a57-4028-9d04-8f28f89c8d6f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:53.940803 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4e466b17-9a57-4028-9d04-8f28f89c8d6f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:53.968593 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-752217d7-a734-4c65-a8ca-e5507e33b934 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:53.969589 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-752217d7-a734-4c65-a8ca-e5507e33b934 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:53.976052 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-752217d7-a734-4c65-a8ca-e5507e33b934 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:53.976544 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-752217d7-a734-4c65-a8ca-e5507e33b934 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:53.977341 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-752217d7-a734-4c65-a8ca-e5507e33b934 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:53.977782 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-752217d7-a734-4c65-a8ca-e5507e33b934 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:54.008804 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-752217d7-a734-4c65-a8ca-e5507e33b934 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043798 Jan 17 21:22:54.009371 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 188/379] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:22:53 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:22:54.074832 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4e466b17-9a57-4028-9d04-8f28f89c8d6f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:54.082577 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4e466b17-9a57-4028-9d04-8f28f89c8d6f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.154046 Jan 17 21:22:54.083139 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 192/380] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:53 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:54.514086 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1c22d68e-aee1-4bca-bbd2-45eb8f90e175 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:54.514615 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1c22d68e-aee1-4bca-bbd2-45eb8f90e175 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:54.520484 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c22d68e-aee1-4bca-bbd2-45eb8f90e175 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:54.520946 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c22d68e-aee1-4bca-bbd2-45eb8f90e175 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:54.521731 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c22d68e-aee1-4bca-bbd2-45eb8f90e175 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:54.522178 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c22d68e-aee1-4bca-bbd2-45eb8f90e175 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:54.652173 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1c22d68e-aee1-4bca-bbd2-45eb8f90e175 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:54.659381 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1c22d68e-aee1-4bca-bbd2-45eb8f90e175 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.149022 Jan 17 21:22:54.659931 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 189/381] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:54 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:55.020203 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-fc5bde53-6c1d-4601-834e-9375152ce953 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:55.021195 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-fc5bde53-6c1d-4601-834e-9375152ce953 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:55.028168 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fc5bde53-6c1d-4601-834e-9375152ce953 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:55.028662 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fc5bde53-6c1d-4601-834e-9375152ce953 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:55.029583 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fc5bde53-6c1d-4601-834e-9375152ce953 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:55.029922 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fc5bde53-6c1d-4601-834e-9375152ce953 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:55.058183 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-fc5bde53-6c1d-4601-834e-9375152ce953 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041674 Jan 17 21:22:55.058735 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 193/382] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:22:55 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:55.100171 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ce2f0cf3-6e02-4e4e-80c0-6407422d5c8b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:55.100912 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ce2f0cf3-6e02-4e4e-80c0-6407422d5c8b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:55.107146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ce2f0cf3-6e02-4e4e-80c0-6407422d5c8b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:55.107597 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ce2f0cf3-6e02-4e4e-80c0-6407422d5c8b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:55.108395 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ce2f0cf3-6e02-4e4e-80c0-6407422d5c8b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:55.108836 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ce2f0cf3-6e02-4e4e-80c0-6407422d5c8b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:55.244036 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ce2f0cf3-6e02-4e4e-80c0-6407422d5c8b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:55.251873 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ce2f0cf3-6e02-4e4e-80c0-6407422d5c8b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.155377 Jan 17 21:22:55.252454 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 190/383] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:55 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:55.677132 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-406ee03a-8e7e-45f3-ad76-67f591eef440 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:55.677738 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-406ee03a-8e7e-45f3-ad76-67f591eef440 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:55.684227 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-406ee03a-8e7e-45f3-ad76-67f591eef440 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:55.684712 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-406ee03a-8e7e-45f3-ad76-67f591eef440 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:55.685487 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-406ee03a-8e7e-45f3-ad76-67f591eef440 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:55.685924 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-406ee03a-8e7e-45f3-ad76-67f591eef440 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:55.814851 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-406ee03a-8e7e-45f3-ad76-67f591eef440 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:55.822214 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-406ee03a-8e7e-45f3-ad76-67f591eef440 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.148679 Jan 17 21:22:55.822957 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 194/384] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:55 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:56.068898 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8f9359b0-10a6-44d9-a420-ff4b5ec88743 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:56.069868 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8f9359b0-10a6-44d9-a420-ff4b5ec88743 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:56.075720 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8f9359b0-10a6-44d9-a420-ff4b5ec88743 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:56.076183 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8f9359b0-10a6-44d9-a420-ff4b5ec88743 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:56.076998 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8f9359b0-10a6-44d9-a420-ff4b5ec88743 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:56.077443 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8f9359b0-10a6-44d9-a420-ff4b5ec88743 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:56.107293 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8f9359b0-10a6-44d9-a420-ff4b5ec88743 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042066 Jan 17 21:22:56.107935 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 191/385] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:22:56 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:56.269526 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-30b6a5a3-8fa3-407c-9e52-9bba02c2607d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:56.270062 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-30b6a5a3-8fa3-407c-9e52-9bba02c2607d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:56.276868 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-30b6a5a3-8fa3-407c-9e52-9bba02c2607d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:56.276974 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-30b6a5a3-8fa3-407c-9e52-9bba02c2607d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:56.277717 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-30b6a5a3-8fa3-407c-9e52-9bba02c2607d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:56.278157 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-30b6a5a3-8fa3-407c-9e52-9bba02c2607d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:56.408924 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-30b6a5a3-8fa3-407c-9e52-9bba02c2607d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:56.417396 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-30b6a5a3-8fa3-407c-9e52-9bba02c2607d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.151962 Jan 17 21:22:56.417963 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 195/386] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:56 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:56.839664 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ac674fc2-01e6-45cc-bdd1-4400940c1814 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:56.840301 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ac674fc2-01e6-45cc-bdd1-4400940c1814 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:56.846774 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac674fc2-01e6-45cc-bdd1-4400940c1814 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:56.847337 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac674fc2-01e6-45cc-bdd1-4400940c1814 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:56.848299 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac674fc2-01e6-45cc-bdd1-4400940c1814 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:56.848781 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac674fc2-01e6-45cc-bdd1-4400940c1814 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:56.987507 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ac674fc2-01e6-45cc-bdd1-4400940c1814 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:56.995002 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ac674fc2-01e6-45cc-bdd1-4400940c1814 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.159734 Jan 17 21:22:56.995566 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 192/387] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:56 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:57.118781 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-49db1f60-3e7c-438e-9437-92bddd1eafc4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:57.119698 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-49db1f60-3e7c-438e-9437-92bddd1eafc4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:57.125682 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-49db1f60-3e7c-438e-9437-92bddd1eafc4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:57.126135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-49db1f60-3e7c-438e-9437-92bddd1eafc4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:57.126924 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-49db1f60-3e7c-438e-9437-92bddd1eafc4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:57.127365 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-49db1f60-3e7c-438e-9437-92bddd1eafc4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:57.157202 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-49db1f60-3e7c-438e-9437-92bddd1eafc4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042198 Jan 17 21:22:57.157755 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 196/388] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:22:57 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:57.434874 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-08777f74-e4b0-418e-8396-ac5c51ece2d4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:57.435491 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-08777f74-e4b0-418e-8396-ac5c51ece2d4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:57.441783 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08777f74-e4b0-418e-8396-ac5c51ece2d4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:57.442240 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08777f74-e4b0-418e-8396-ac5c51ece2d4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:57.443017 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08777f74-e4b0-418e-8396-ac5c51ece2d4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:57.443457 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08777f74-e4b0-418e-8396-ac5c51ece2d4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:57.575046 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-08777f74-e4b0-418e-8396-ac5c51ece2d4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:57.583098 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-08777f74-e4b0-418e-8396-ac5c51ece2d4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.151932 Jan 17 21:22:57.583657 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 193/389] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:57 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:58.011787 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-37006bcd-e7ad-49de-b8ef-08b99127df0f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:58.012412 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-37006bcd-e7ad-49de-b8ef-08b99127df0f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:58.018700 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-37006bcd-e7ad-49de-b8ef-08b99127df0f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:58.019145 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-37006bcd-e7ad-49de-b8ef-08b99127df0f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:58.019968 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-37006bcd-e7ad-49de-b8ef-08b99127df0f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:58.020415 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-37006bcd-e7ad-49de-b8ef-08b99127df0f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:58.158812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-37006bcd-e7ad-49de-b8ef-08b99127df0f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:58.166904 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-37006bcd-e7ad-49de-b8ef-08b99127df0f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.158801 Jan 17 21:22:58.167465 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 197/390] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:58 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:58.168942 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1d9dca85-4522-47c7-9987-52aef0583844 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:58.170061 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1d9dca85-4522-47c7-9987-52aef0583844 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:58.175830 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d9dca85-4522-47c7-9987-52aef0583844 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:58.176278 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d9dca85-4522-47c7-9987-52aef0583844 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:58.177095 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d9dca85-4522-47c7-9987-52aef0583844 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:58.177534 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d9dca85-4522-47c7-9987-52aef0583844 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:58.205057 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1d9dca85-4522-47c7-9987-52aef0583844 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040517 Jan 17 21:22:58.205594 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 194/391] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:22:58 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:22:58.600255 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-35747cb6-de42-451a-88fd-0a01378fab08 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:58.600809 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-35747cb6-de42-451a-88fd-0a01378fab08 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:58.607123 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-35747cb6-de42-451a-88fd-0a01378fab08 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:58.607580 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-35747cb6-de42-451a-88fd-0a01378fab08 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:58.608365 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-35747cb6-de42-451a-88fd-0a01378fab08 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:58.608900 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-35747cb6-de42-451a-88fd-0a01378fab08 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:58.741645 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-35747cb6-de42-451a-88fd-0a01378fab08 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:58.749432 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-35747cb6-de42-451a-88fd-0a01378fab08 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.152884 Jan 17 21:22:58.749994 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 198/392] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:58 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:59.183541 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-77f70b27-3f75-4205-be1f-a1914ca68173 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:59.184060 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-77f70b27-3f75-4205-be1f-a1914ca68173 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:59.190428 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77f70b27-3f75-4205-be1f-a1914ca68173 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:59.190887 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77f70b27-3f75-4205-be1f-a1914ca68173 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:59.191676 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77f70b27-3f75-4205-be1f-a1914ca68173 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:59.192119 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77f70b27-3f75-4205-be1f-a1914ca68173 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:59.217162 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-dbb1f085-8421-4617-9188-5675378f4e93 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:59.218063 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-dbb1f085-8421-4617-9188-5675378f4e93 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:59.224244 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dbb1f085-8421-4617-9188-5675378f4e93 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:59.224795 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dbb1f085-8421-4617-9188-5675378f4e93 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:59.225500 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dbb1f085-8421-4617-9188-5675378f4e93 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:59.225932 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dbb1f085-8421-4617-9188-5675378f4e93 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:59.254574 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-dbb1f085-8421-4617-9188-5675378f4e93 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041303 Jan 17 21:22:59.255126 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 199/393] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:22:59 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:22:59.324948 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-77f70b27-3f75-4205-be1f-a1914ca68173 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:59.333088 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-77f70b27-3f75-4205-be1f-a1914ca68173 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.153284 Jan 17 21:22:59.333653 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 195/394] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:59 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:22:59.767199 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-cb05c59e-5252-4c72-9847-6973d8d2cd51 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:22:59.767814 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-cb05c59e-5252-4c72-9847-6973d8d2cd51 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:22:59.774162 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cb05c59e-5252-4c72-9847-6973d8d2cd51 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:59.774686 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cb05c59e-5252-4c72-9847-6973d8d2cd51 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:59.775557 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cb05c59e-5252-4c72-9847-6973d8d2cd51 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:22:59.776037 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cb05c59e-5252-4c72-9847-6973d8d2cd51 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:22:59.904884 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-cb05c59e-5252-4c72-9847-6973d8d2cd51 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:22:59.912675 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-cb05c59e-5252-4c72-9847-6973d8d2cd51 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.149304 Jan 17 21:22:59.913270 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 200/395] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:22:59 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:00.267480 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6708b28c-ea65-4575-82b2-2894bdf89547 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:00.268583 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6708b28c-ea65-4575-82b2-2894bdf89547 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:00.275814 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6708b28c-ea65-4575-82b2-2894bdf89547 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:00.276269 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6708b28c-ea65-4575-82b2-2894bdf89547 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:00.277104 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6708b28c-ea65-4575-82b2-2894bdf89547 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:00.277549 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6708b28c-ea65-4575-82b2-2894bdf89547 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:00.308189 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6708b28c-ea65-4575-82b2-2894bdf89547 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045305 Jan 17 21:23:00.308703 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 196/396] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:00 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:23:00.350422 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2a7ed23a-bea9-4304-9637-e97af58e1385 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:00.351064 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2a7ed23a-bea9-4304-9637-e97af58e1385 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:00.358005 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a7ed23a-bea9-4304-9637-e97af58e1385 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:00.358463 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a7ed23a-bea9-4304-9637-e97af58e1385 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:00.359246 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a7ed23a-bea9-4304-9637-e97af58e1385 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:00.359687 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a7ed23a-bea9-4304-9637-e97af58e1385 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:00.490976 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2a7ed23a-bea9-4304-9637-e97af58e1385 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:00.498799 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2a7ed23a-bea9-4304-9637-e97af58e1385 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.151962 Jan 17 21:23:00.499360 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 201/397] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:00 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:00.931939 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-9aaa5cae-60d0-4d34-ae44-b4c021731a57 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:00.932584 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-9aaa5cae-60d0-4d34-ae44-b4c021731a57 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:00.939150 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9aaa5cae-60d0-4d34-ae44-b4c021731a57 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:00.939609 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9aaa5cae-60d0-4d34-ae44-b4c021731a57 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:00.940428 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9aaa5cae-60d0-4d34-ae44-b4c021731a57 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:00.940863 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9aaa5cae-60d0-4d34-ae44-b4c021731a57 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:01.078048 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-9aaa5cae-60d0-4d34-ae44-b4c021731a57 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:01.085994 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-9aaa5cae-60d0-4d34-ae44-b4c021731a57 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.158533 Jan 17 21:23:01.086596 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 197/398] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:00 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:01.319029 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-17a12bb1-3f02-4d5e-98bc-166fb135a31f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:01.319937 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-17a12bb1-3f02-4d5e-98bc-166fb135a31f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:01.326550 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17a12bb1-3f02-4d5e-98bc-166fb135a31f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:01.326927 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17a12bb1-3f02-4d5e-98bc-166fb135a31f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:01.327714 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17a12bb1-3f02-4d5e-98bc-166fb135a31f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:01.328154 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17a12bb1-3f02-4d5e-98bc-166fb135a31f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:01.361593 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-17a12bb1-3f02-4d5e-98bc-166fb135a31f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046249 Jan 17 21:23:01.362330 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 202/399] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:01 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:01.515056 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-84a8db1e-ac71-4de1-9f42-ca9879e033ff tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:01.515758 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-84a8db1e-ac71-4de1-9f42-ca9879e033ff tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:01.522175 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-84a8db1e-ac71-4de1-9f42-ca9879e033ff tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:01.522633 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-84a8db1e-ac71-4de1-9f42-ca9879e033ff tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:01.523424 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-84a8db1e-ac71-4de1-9f42-ca9879e033ff tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:01.524460 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-84a8db1e-ac71-4de1-9f42-ca9879e033ff tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:01.651119 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-84a8db1e-ac71-4de1-9f42-ca9879e033ff tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:01.658321 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-84a8db1e-ac71-4de1-9f42-ca9879e033ff tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.146884 Jan 17 21:23:01.658883 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 198/400] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:01 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:02.102767 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-016f9d8f-d3fb-4789-b004-b65a3af52997 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:02.103365 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-016f9d8f-d3fb-4789-b004-b65a3af52997 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:02.109285 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-016f9d8f-d3fb-4789-b004-b65a3af52997 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:02.109742 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-016f9d8f-d3fb-4789-b004-b65a3af52997 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:02.110522 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-016f9d8f-d3fb-4789-b004-b65a3af52997 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:02.110989 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-016f9d8f-d3fb-4789-b004-b65a3af52997 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:02.243396 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-016f9d8f-d3fb-4789-b004-b65a3af52997 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:02.251105 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-016f9d8f-d3fb-4789-b004-b65a3af52997 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.151968 Jan 17 21:23:02.251667 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 203/401] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:02 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:02.374146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-03a426a4-3961-4594-bec1-a68491fac607 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:02.375061 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-03a426a4-3961-4594-bec1-a68491fac607 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:02.381092 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03a426a4-3961-4594-bec1-a68491fac607 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:02.381548 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03a426a4-3961-4594-bec1-a68491fac607 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:02.382334 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03a426a4-3961-4594-bec1-a68491fac607 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:02.382772 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03a426a4-3961-4594-bec1-a68491fac607 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:02.411292 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-03a426a4-3961-4594-bec1-a68491fac607 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040827 Jan 17 21:23:02.411869 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 199/402] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:02 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:02.674655 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-add020cc-942b-42d1-a527-684c0b4063ca tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:02.675259 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-add020cc-942b-42d1-a527-684c0b4063ca tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:02.681950 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-add020cc-942b-42d1-a527-684c0b4063ca tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:02.682397 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-add020cc-942b-42d1-a527-684c0b4063ca tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:02.683172 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-add020cc-942b-42d1-a527-684c0b4063ca tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:02.683603 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-add020cc-942b-42d1-a527-684c0b4063ca tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:02.817829 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-add020cc-942b-42d1-a527-684c0b4063ca tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:02.825337 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-add020cc-942b-42d1-a527-684c0b4063ca tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.154248 Jan 17 21:23:02.825925 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 204/403] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:02 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:03.268198 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-dc7a63ca-f85e-4539-89f5-3103907bf817 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:03.269076 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-dc7a63ca-f85e-4539-89f5-3103907bf817 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:03.275409 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dc7a63ca-f85e-4539-89f5-3103907bf817 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:03.275880 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dc7a63ca-f85e-4539-89f5-3103907bf817 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:03.276680 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dc7a63ca-f85e-4539-89f5-3103907bf817 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:03.277121 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dc7a63ca-f85e-4539-89f5-3103907bf817 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:03.406706 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-dc7a63ca-f85e-4539-89f5-3103907bf817 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:03.415042 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-dc7a63ca-f85e-4539-89f5-3103907bf817 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.149814 Jan 17 21:23:03.415615 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 200/404] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:03 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:03.422894 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8652b1b8-9e32-4f10-8ad4-b288d3263e46 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:03.423799 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8652b1b8-9e32-4f10-8ad4-b288d3263e46 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:03.429641 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8652b1b8-9e32-4f10-8ad4-b288d3263e46 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:03.430093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8652b1b8-9e32-4f10-8ad4-b288d3263e46 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:03.430880 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8652b1b8-9e32-4f10-8ad4-b288d3263e46 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:03.431321 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8652b1b8-9e32-4f10-8ad4-b288d3263e46 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:03.459225 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8652b1b8-9e32-4f10-8ad4-b288d3263e46 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040071 Jan 17 21:23:03.459793 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 205/405] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:03 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:03.842058 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d80a14ba-0240-42a3-8cc8-8efb1567a463 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:03.842668 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d80a14ba-0240-42a3-8cc8-8efb1567a463 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:03.848572 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d80a14ba-0240-42a3-8cc8-8efb1567a463 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:03.849026 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d80a14ba-0240-42a3-8cc8-8efb1567a463 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:03.849811 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d80a14ba-0240-42a3-8cc8-8efb1567a463 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:03.850256 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d80a14ba-0240-42a3-8cc8-8efb1567a463 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:03.985610 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d80a14ba-0240-42a3-8cc8-8efb1567a463 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:03.993491 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d80a14ba-0240-42a3-8cc8-8efb1567a463 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.154766 Jan 17 21:23:03.994226 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 201/406] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:03 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:04.433419 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-62afcf00-cdff-4c2c-9325-f2cd890cd31f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:04.433988 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-62afcf00-cdff-4c2c-9325-f2cd890cd31f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:04.440398 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-62afcf00-cdff-4c2c-9325-f2cd890cd31f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:04.440854 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-62afcf00-cdff-4c2c-9325-f2cd890cd31f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:04.441651 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-62afcf00-cdff-4c2c-9325-f2cd890cd31f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:04.442123 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-62afcf00-cdff-4c2c-9325-f2cd890cd31f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:04.471181 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5b61c14f-76b6-4db9-9a2c-0b45b743ed70 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:04.472091 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5b61c14f-76b6-4db9-9a2c-0b45b743ed70 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:04.479361 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5b61c14f-76b6-4db9-9a2c-0b45b743ed70 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:04.479814 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5b61c14f-76b6-4db9-9a2c-0b45b743ed70 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:04.480640 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5b61c14f-76b6-4db9-9a2c-0b45b743ed70 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:04.481084 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5b61c14f-76b6-4db9-9a2c-0b45b743ed70 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:04.511610 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5b61c14f-76b6-4db9-9a2c-0b45b743ed70 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044146 Jan 17 21:23:04.512189 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 202/407] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:04 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:23:04.576326 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-62afcf00-cdff-4c2c-9325-f2cd890cd31f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:04.584311 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-62afcf00-cdff-4c2c-9325-f2cd890cd31f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.155187 Jan 17 21:23:04.584953 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 206/408] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:04 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:05.009867 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1525b868-d303-41ac-a6db-f69dca58dbe8 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:05.010480 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1525b868-d303-41ac-a6db-f69dca58dbe8 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:05.016436 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1525b868-d303-41ac-a6db-f69dca58dbe8 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:05.016905 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1525b868-d303-41ac-a6db-f69dca58dbe8 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:05.017706 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1525b868-d303-41ac-a6db-f69dca58dbe8 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:05.018157 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1525b868-d303-41ac-a6db-f69dca58dbe8 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:05.158879 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1525b868-d303-41ac-a6db-f69dca58dbe8 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:05.166982 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1525b868-d303-41ac-a6db-f69dca58dbe8 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.160542 Jan 17 21:23:05.167558 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 203/409] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:05 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:05.522182 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f6449ac8-bd55-4314-8fe1-bc932e2bfea8 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:05.523091 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f6449ac8-bd55-4314-8fe1-bc932e2bfea8 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:05.530044 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f6449ac8-bd55-4314-8fe1-bc932e2bfea8 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:05.530499 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f6449ac8-bd55-4314-8fe1-bc932e2bfea8 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:05.531289 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f6449ac8-bd55-4314-8fe1-bc932e2bfea8 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:05.531727 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f6449ac8-bd55-4314-8fe1-bc932e2bfea8 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:05.560122 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f6449ac8-bd55-4314-8fe1-bc932e2bfea8 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041671 Jan 17 21:23:05.560705 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 207/410] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:05 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:05.601188 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b24b34fe-9cb6-424b-a9ee-386c448f7133 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:05.601802 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b24b34fe-9cb6-424b-a9ee-386c448f7133 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:05.608016 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b24b34fe-9cb6-424b-a9ee-386c448f7133 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:05.608509 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b24b34fe-9cb6-424b-a9ee-386c448f7133 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:05.609300 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b24b34fe-9cb6-424b-a9ee-386c448f7133 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:05.609741 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b24b34fe-9cb6-424b-a9ee-386c448f7133 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:05.748122 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b24b34fe-9cb6-424b-a9ee-386c448f7133 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:05.754945 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b24b34fe-9cb6-424b-a9ee-386c448f7133 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.157366 Jan 17 21:23:05.755506 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 204/411] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:05 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:06.182769 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-60bccd1e-6d48-4688-8e3a-0dd842bf50d5 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:06.183380 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-60bccd1e-6d48-4688-8e3a-0dd842bf50d5 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:06.189256 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-60bccd1e-6d48-4688-8e3a-0dd842bf50d5 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:06.189710 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-60bccd1e-6d48-4688-8e3a-0dd842bf50d5 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:06.190490 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-60bccd1e-6d48-4688-8e3a-0dd842bf50d5 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:06.190934 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-60bccd1e-6d48-4688-8e3a-0dd842bf50d5 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:06.321408 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-60bccd1e-6d48-4688-8e3a-0dd842bf50d5 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:06.328764 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-60bccd1e-6d48-4688-8e3a-0dd842bf50d5 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.149611 Jan 17 21:23:06.329333 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 208/412] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:06 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:06.570809 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-26cb27fb-495b-4d85-ae24-dad12fe2808a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:06.571704 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-26cb27fb-495b-4d85-ae24-dad12fe2808a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:06.577598 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-26cb27fb-495b-4d85-ae24-dad12fe2808a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:06.578046 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-26cb27fb-495b-4d85-ae24-dad12fe2808a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:06.578873 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-26cb27fb-495b-4d85-ae24-dad12fe2808a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:06.579399 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-26cb27fb-495b-4d85-ae24-dad12fe2808a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:06.609697 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-26cb27fb-495b-4d85-ae24-dad12fe2808a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 Jan 17 21:23:06.610337 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 205/413] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:06 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:06.772341 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6f02d5ca-d7f3-4264-a592-af3992a8f4db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:06.772987 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6f02d5ca-d7f3-4264-a592-af3992a8f4db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:06.780787 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6f02d5ca-d7f3-4264-a592-af3992a8f4db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:06.781176 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6f02d5ca-d7f3-4264-a592-af3992a8f4db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:06.781995 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6f02d5ca-d7f3-4264-a592-af3992a8f4db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:06.782693 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6f02d5ca-d7f3-4264-a592-af3992a8f4db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:06.916327 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6f02d5ca-d7f3-4264-a592-af3992a8f4db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:06.924023 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6f02d5ca-d7f3-4264-a592-af3992a8f4db tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.155382 Jan 17 21:23:06.924619 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 209/414] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:06 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:07.346719 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4d6ffd5c-507e-4341-a372-f2d2b924394c tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:07.347336 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4d6ffd5c-507e-4341-a372-f2d2b924394c tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:07.353302 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4d6ffd5c-507e-4341-a372-f2d2b924394c tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:07.353756 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4d6ffd5c-507e-4341-a372-f2d2b924394c tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:07.354540 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4d6ffd5c-507e-4341-a372-f2d2b924394c tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:07.354991 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4d6ffd5c-507e-4341-a372-f2d2b924394c tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:07.482902 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4d6ffd5c-507e-4341-a372-f2d2b924394c tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:07.490211 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4d6ffd5c-507e-4341-a372-f2d2b924394c tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.147097 Jan 17 21:23:07.490774 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 206/415] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:07 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:07.621442 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a947bd91-417a-4ee2-b01f-b78145c99ce7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:07.622349 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a947bd91-417a-4ee2-b01f-b78145c99ce7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:07.628153 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a947bd91-417a-4ee2-b01f-b78145c99ce7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:07.628647 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a947bd91-417a-4ee2-b01f-b78145c99ce7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:07.629439 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a947bd91-417a-4ee2-b01f-b78145c99ce7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:07.629879 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a947bd91-417a-4ee2-b01f-b78145c99ce7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:07.659404 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a947bd91-417a-4ee2-b01f-b78145c99ce7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042238 Jan 17 21:23:07.659961 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 210/416] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:07 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:07.940771 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a8cc4972-3440-4292-b6a8-39c53de948f5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:07.941392 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a8cc4972-3440-4292-b6a8-39c53de948f5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:07.948636 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a8cc4972-3440-4292-b6a8-39c53de948f5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:07.949097 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a8cc4972-3440-4292-b6a8-39c53de948f5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:07.949890 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a8cc4972-3440-4292-b6a8-39c53de948f5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:07.950334 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a8cc4972-3440-4292-b6a8-39c53de948f5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:08.092999 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a8cc4972-3440-4292-b6a8-39c53de948f5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:08.101945 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a8cc4972-3440-4292-b6a8-39c53de948f5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.164501 Jan 17 21:23:08.102861 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 207/417] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:07 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:08.507225 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-59e18d30-284a-42fe-be4a-f24783b30886 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:08.507970 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-59e18d30-284a-42fe-be4a-f24783b30886 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:08.514162 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-59e18d30-284a-42fe-be4a-f24783b30886 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:08.514702 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-59e18d30-284a-42fe-be4a-f24783b30886 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:08.515607 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-59e18d30-284a-42fe-be4a-f24783b30886 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:08.516117 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-59e18d30-284a-42fe-be4a-f24783b30886 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:08.662038 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-59e18d30-284a-42fe-be4a-f24783b30886 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:08.670577 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-59e18d30-284a-42fe-be4a-f24783b30886 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.167151 Jan 17 21:23:08.671125 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 211/418] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:08 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:08.671266 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-271c3596-5e38-4657-b63d-9bc5b99a49d3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:08.672823 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-271c3596-5e38-4657-b63d-9bc5b99a49d3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:08.678721 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-271c3596-5e38-4657-b63d-9bc5b99a49d3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:08.679184 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-271c3596-5e38-4657-b63d-9bc5b99a49d3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:08.680037 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-271c3596-5e38-4657-b63d-9bc5b99a49d3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:08.680706 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-271c3596-5e38-4657-b63d-9bc5b99a49d3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:08.710341 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-271c3596-5e38-4657-b63d-9bc5b99a49d3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042884 Jan 17 21:23:08.711762 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 208/419] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:08 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:23:09.118910 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4dfde78d-7268-47a6-8dcb-f620e5692ea1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:09.120090 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4dfde78d-7268-47a6-8dcb-f620e5692ea1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:09.126276 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4dfde78d-7268-47a6-8dcb-f620e5692ea1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:09.126735 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4dfde78d-7268-47a6-8dcb-f620e5692ea1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:09.127562 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4dfde78d-7268-47a6-8dcb-f620e5692ea1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:09.128036 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4dfde78d-7268-47a6-8dcb-f620e5692ea1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:09.276164 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4dfde78d-7268-47a6-8dcb-f620e5692ea1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:09.294282 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4dfde78d-7268-47a6-8dcb-f620e5692ea1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.179102 Jan 17 21:23:09.294859 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 212/420] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:09 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:09.687284 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d3e96345-631a-4703-909f-e31efb748a67 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:09.687888 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d3e96345-631a-4703-909f-e31efb748a67 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:09.694429 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d3e96345-631a-4703-909f-e31efb748a67 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:09.694876 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d3e96345-631a-4703-909f-e31efb748a67 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:09.695698 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d3e96345-631a-4703-909f-e31efb748a67 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:09.696119 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d3e96345-631a-4703-909f-e31efb748a67 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:09.724258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-43536391-72b6-4c5d-8384-98d7bac42db5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:09.726071 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-43536391-72b6-4c5d-8384-98d7bac42db5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:09.733703 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-43536391-72b6-4c5d-8384-98d7bac42db5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:09.734417 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-43536391-72b6-4c5d-8384-98d7bac42db5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:09.735379 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-43536391-72b6-4c5d-8384-98d7bac42db5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:09.735973 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-43536391-72b6-4c5d-8384-98d7bac42db5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:09.774328 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-43536391-72b6-4c5d-8384-98d7bac42db5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054765 Jan 17 21:23:09.775042 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 213/421] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:09 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:23:09.874625 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d3e96345-631a-4703-909f-e31efb748a67 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:09.882484 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d3e96345-631a-4703-909f-e31efb748a67 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.198785 Jan 17 21:23:09.893049 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 209/422] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:09 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:09.967122 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-950588880", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452", "networks": [{"uuid": "90270886-8b72-4996-b451-52316e1bfe26"}]}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:23:10.022665 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.network.neutron [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] validate_networks() for [('90270886-8b72-4996-b451-52316e1bfe26', None, None, None, None, None)] {{(pid=116183) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:23:10.311955 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e6dbc6ee-d8cc-49d4-9ed9-96a6d790311e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:10.318037 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e6dbc6ee-d8cc-49d4-9ed9-96a6d790311e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:10.325143 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e6dbc6ee-d8cc-49d4-9ed9-96a6d790311e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:10.325598 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e6dbc6ee-d8cc-49d4-9ed9-96a6d790311e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:10.326391 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e6dbc6ee-d8cc-49d4-9ed9-96a6d790311e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:10.326988 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e6dbc6ee-d8cc-49d4-9ed9-96a6d790311e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:10.527678 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Flavor limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:23:10.528276 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Image limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:23:10.528859 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Flavor pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:23:10.529365 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Image pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:23:10.530046 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:23:10.544025 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:10.545495 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:10.547216 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:10.549147 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:10.555642 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-e6dbc6ee-d8cc-49d4-9ed9-96a6d790311e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:10.564595 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e6dbc6ee-d8cc-49d4-9ed9-96a6d790311e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.256773 Jan 17 21:23:10.573526 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Getting quotas for project 28496391913444ba9a1f04ca404c2c68. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:23:10.576807 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 210/423] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:10 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:10.578149 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Getting quotas for user 5cfa3e62e8f64305a304058e9704ef23 and project 28496391913444ba9a1f04ca404c2c68. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:23:10.592730 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Going to run 1 instances... {{(pid=116183) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:23:10.596389 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:23:10.653816 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4961913d-30ce-4f9e-9464-bd1a917b2931 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690396 Jan 17 21:23:10.654987 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 214/424] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:23:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:23:10.665093 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-489b122f-5637-4c37-b427-06bb908deb03 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:10.665862 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-489b122f-5637-4c37-b427-06bb908deb03 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:10.755311 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-489b122f-5637-4c37-b427-06bb908deb03 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:10.774205 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-489b122f-5637-4c37-b427-06bb908deb03 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1217 microversion: 2.1 time: 0.112803 Jan 17 21:23:10.775129 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 211/425] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:10 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:23:10.900137 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-57e54224-55ff-4991-b1be-32077444eeb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:10.902011 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-57e54224-55ff-4991-b1be-32077444eeb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:10.918767 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-57e54224-55ff-4991-b1be-32077444eeb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:10.919233 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-57e54224-55ff-4991-b1be-32077444eeb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:10.921502 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-57e54224-55ff-4991-b1be-32077444eeb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:10.922030 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-57e54224-55ff-4991-b1be-32077444eeb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:11.111152 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-57e54224-55ff-4991-b1be-32077444eeb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:11.121698 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-57e54224-55ff-4991-b1be-32077444eeb6 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.226581 Jan 17 21:23:11.123423 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 215/426] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:10 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:11.356196 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-226806f4-359c-448d-8893-95833151ba22 req-b76942e5-1a3f-4f65-ad16-f0f18c4cf8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722796bd-49c1-4a74-9f3c-f9ea7863440c", "name": "network-vif-plugged", "status": "completed", "tag": "b7b6c108-ba5a-4fa7-98f2-021e2ac61686"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:23:11.358335 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:23:11.358335 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:23:11.373560 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-226806f4-359c-448d-8893-95833151ba22 req-b76942e5-1a3f-4f65-ad16-f0f18c4cf8cb service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:11.373898 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-226806f4-359c-448d-8893-95833151ba22 req-b76942e5-1a3f-4f65-ad16-f0f18c4cf8cb service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:11.394412 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-226806f4-359c-448d-8893-95833151ba22 req-b76942e5-1a3f-4f65-ad16-f0f18c4cf8cb service nova] Creating event network-vif-plugged:b7b6c108-ba5a-4fa7-98f2-021e2ac61686 for instance 722796bd-49c1-4a74-9f3c-f9ea7863440c on hv-cinder-82489 Jan 17 21:23:11.403721 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-226806f4-359c-448d-8893-95833151ba22 req-b76942e5-1a3f-4f65-ad16-f0f18c4cf8cb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050116 Jan 17 21:23:11.405359 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 212/427] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:11.583573 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c39e8cd5-df7c-47d5-b34f-65ac4fcce0c3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:11.584475 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c39e8cd5-df7c-47d5-b34f-65ac4fcce0c3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:11.595681 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c39e8cd5-df7c-47d5-b34f-65ac4fcce0c3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:11.596219 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c39e8cd5-df7c-47d5-b34f-65ac4fcce0c3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:11.597114 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c39e8cd5-df7c-47d5-b34f-65ac4fcce0c3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:11.597746 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c39e8cd5-df7c-47d5-b34f-65ac4fcce0c3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:11.806232 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-85cd6335-8b4a-48e4-8dab-30d3a89830f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:11.812134 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-85cd6335-8b4a-48e4-8dab-30d3a89830f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:11.842103 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-85cd6335-8b4a-48e4-8dab-30d3a89830f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:11.842657 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-85cd6335-8b4a-48e4-8dab-30d3a89830f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:11.845351 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-c39e8cd5-df7c-47d5-b34f-65ac4fcce0c3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:11.848998 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-85cd6335-8b4a-48e4-8dab-30d3a89830f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:11.848998 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-85cd6335-8b4a-48e4-8dab-30d3a89830f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:11.874658 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c39e8cd5-df7c-47d5-b34f-65ac4fcce0c3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.295053 Jan 17 21:23:11.875410 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 216/428] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:11 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:11.944495 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-85cd6335-8b4a-48e4-8dab-30d3a89830f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:11.952820 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-85cd6335-8b4a-48e4-8dab-30d3a89830f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1269 microversion: 2.1 time: 0.164076 Jan 17 21:23:11.953423 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 213/429] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:11 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:23:12.140472 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7ef220b9-5d29-4be3-8f5b-8d4c69f846a9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:12.143054 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7ef220b9-5d29-4be3-8f5b-8d4c69f846a9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:12.153270 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7ef220b9-5d29-4be3-8f5b-8d4c69f846a9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:12.153885 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7ef220b9-5d29-4be3-8f5b-8d4c69f846a9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:12.155017 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7ef220b9-5d29-4be3-8f5b-8d4c69f846a9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:12.155714 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7ef220b9-5d29-4be3-8f5b-8d4c69f846a9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:12.381961 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7ef220b9-5d29-4be3-8f5b-8d4c69f846a9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:12.390965 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7ef220b9-5d29-4be3-8f5b-8d4c69f846a9 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.254616 Jan 17 21:23:12.391557 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 217/430] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:12 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:12.892879 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f5d926e3-262a-4332-9fa7-1d8f2e9ec24b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:12.893652 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f5d926e3-262a-4332-9fa7-1d8f2e9ec24b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:12.905893 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f5d926e3-262a-4332-9fa7-1d8f2e9ec24b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:12.908977 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f5d926e3-262a-4332-9fa7-1d8f2e9ec24b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:12.909836 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f5d926e3-262a-4332-9fa7-1d8f2e9ec24b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:12.910279 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f5d926e3-262a-4332-9fa7-1d8f2e9ec24b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:12.969895 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ebad6c6f-e534-45d6-9736-f6d520b30156 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:12.970690 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ebad6c6f-e534-45d6-9736-f6d520b30156 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:12.980045 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebad6c6f-e534-45d6-9736-f6d520b30156 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:12.980932 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebad6c6f-e534-45d6-9736-f6d520b30156 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:12.981921 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebad6c6f-e534-45d6-9736-f6d520b30156 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:12.987743 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebad6c6f-e534-45d6-9736-f6d520b30156 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:13.158954 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ebad6c6f-e534-45d6-9736-f6d520b30156 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:13.167127 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ebad6c6f-e534-45d6-9736-f6d520b30156 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1275 microversion: 2.1 time: 0.200794 Jan 17 21:23:13.173640 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 218/431] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:12 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1275 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:13.209695 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f5d926e3-262a-4332-9fa7-1d8f2e9ec24b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:13.223754 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f5d926e3-262a-4332-9fa7-1d8f2e9ec24b tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.335757 Jan 17 21:23:13.237112 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 214/432] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:12 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:13.409481 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-76f2c9e3-86fc-4652-820f-5a30db5f45ec tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:13.410642 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-76f2c9e3-86fc-4652-820f-5a30db5f45ec tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:13.419538 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-76f2c9e3-86fc-4652-820f-5a30db5f45ec tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:13.420281 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-76f2c9e3-86fc-4652-820f-5a30db5f45ec tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:13.421302 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-76f2c9e3-86fc-4652-820f-5a30db5f45ec tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:13.421905 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-76f2c9e3-86fc-4652-820f-5a30db5f45ec tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:13.583331 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-76f2c9e3-86fc-4652-820f-5a30db5f45ec tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:13.594705 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-76f2c9e3-86fc-4652-820f-5a30db5f45ec tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.190847 Jan 17 21:23:13.595292 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 219/433] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:13 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:14.190660 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6dee1682-b2f6-4dc2-84b0-7fafe0e1ad8d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:14.191305 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6dee1682-b2f6-4dc2-84b0-7fafe0e1ad8d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:14.199858 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6dee1682-b2f6-4dc2-84b0-7fafe0e1ad8d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:14.200651 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6dee1682-b2f6-4dc2-84b0-7fafe0e1ad8d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:14.201801 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6dee1682-b2f6-4dc2-84b0-7fafe0e1ad8d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:14.202465 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6dee1682-b2f6-4dc2-84b0-7fafe0e1ad8d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:14.256676 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b95f67cb-0c34-428d-bc78-6f0e432273a1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:14.258675 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b95f67cb-0c34-428d-bc78-6f0e432273a1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:14.266113 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b95f67cb-0c34-428d-bc78-6f0e432273a1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:14.267257 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b95f67cb-0c34-428d-bc78-6f0e432273a1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:14.268329 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b95f67cb-0c34-428d-bc78-6f0e432273a1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:14.269066 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b95f67cb-0c34-428d-bc78-6f0e432273a1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:14.522551 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6dee1682-b2f6-4dc2-84b0-7fafe0e1ad8d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:14.529253 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b95f67cb-0c34-428d-bc78-6f0e432273a1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:14.538640 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6dee1682-b2f6-4dc2-84b0-7fafe0e1ad8d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1317 microversion: 2.1 time: 0.352206 Jan 17 21:23:14.542696 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b95f67cb-0c34-428d-bc78-6f0e432273a1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1566 microversion: 2.1 time: 0.303213 Jan 17 21:23:14.549391 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 215/434] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:14 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:14.553494 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 220/435] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:14 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1566 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:14.616804 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3e74bb9a-bb07-41e6-99b5-f6110f8f247f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:14.618283 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-3e74bb9a-bb07-41e6-99b5-f6110f8f247f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:14.631274 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3e74bb9a-bb07-41e6-99b5-f6110f8f247f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:14.632097 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3e74bb9a-bb07-41e6-99b5-f6110f8f247f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:14.633837 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3e74bb9a-bb07-41e6-99b5-f6110f8f247f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:14.634867 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3e74bb9a-bb07-41e6-99b5-f6110f8f247f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:14.859657 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-3e74bb9a-bb07-41e6-99b5-f6110f8f247f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:14.869840 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3e74bb9a-bb07-41e6-99b5-f6110f8f247f tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.259952 Jan 17 21:23:14.870808 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 216/436] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:14 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:15.560951 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f9456be0-487c-44d0-b1ce-6681068b7228 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:15.564927 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-780b1a27-e3a9-4078-8d49-f1ea061912e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:15.566979 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-780b1a27-e3a9-4078-8d49-f1ea061912e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:15.567522 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f9456be0-487c-44d0-b1ce-6681068b7228 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:15.579771 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f9456be0-487c-44d0-b1ce-6681068b7228 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:15.582715 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-780b1a27-e3a9-4078-8d49-f1ea061912e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:15.584159 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-780b1a27-e3a9-4078-8d49-f1ea061912e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:15.585278 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-780b1a27-e3a9-4078-8d49-f1ea061912e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:15.586167 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f9456be0-487c-44d0-b1ce-6681068b7228 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:15.587128 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-780b1a27-e3a9-4078-8d49-f1ea061912e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:15.591256 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f9456be0-487c-44d0-b1ce-6681068b7228 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:15.592029 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f9456be0-487c-44d0-b1ce-6681068b7228 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:15.887591 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-780b1a27-e3a9-4078-8d49-f1ea061912e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:15.910590 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-780b1a27-e3a9-4078-8d49-f1ea061912e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1317 microversion: 2.1 time: 0.357778 Jan 17 21:23:15.911535 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 221/437] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:15 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:15.915896 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1966eacc-232d-4ba4-954a-9fd816d1f0c7 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:15.917130 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f9456be0-487c-44d0-b1ce-6681068b7228 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:15.917635 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1966eacc-232d-4ba4-954a-9fd816d1f0c7 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:15.924584 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1966eacc-232d-4ba4-954a-9fd816d1f0c7 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:15.926015 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1966eacc-232d-4ba4-954a-9fd816d1f0c7 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:15.927806 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f9456be0-487c-44d0-b1ce-6681068b7228 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1546 microversion: 2.1 time: 0.370406 Jan 17 21:23:15.928806 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1966eacc-232d-4ba4-954a-9fd816d1f0c7 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:15.929874 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1966eacc-232d-4ba4-954a-9fd816d1f0c7 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:15.930308 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 217/438] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:15 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1546 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:15.947096 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ac0531bc-7262-4315-97b2-3ced6aa9de30 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:15.947758 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ac0531bc-7262-4315-97b2-3ced6aa9de30 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:15.954958 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac0531bc-7262-4315-97b2-3ced6aa9de30 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:15.955837 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac0531bc-7262-4315-97b2-3ced6aa9de30 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:15.957234 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac0531bc-7262-4315-97b2-3ced6aa9de30 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:15.957906 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac0531bc-7262-4315-97b2-3ced6aa9de30 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:16.093795 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-ac0531bc-7262-4315-97b2-3ced6aa9de30 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] HTTP exception thrown: Cannot 'detach_volume' instance 8a5818e4-0026-4597-9ef3-d539c2cdee97 while it is in vm_state rescued Jan 17 21:23:16.094404 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ac0531bc-7262-4315-97b2-3ced6aa9de30 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Returning 409 to user: Cannot 'detach_volume' instance 8a5818e4-0026-4597-9ef3-d539c2cdee97 while it is in vm_state rescued {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:23:16.095241 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ac0531bc-7262-4315-97b2-3ced6aa9de30 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments/9519e024-8d11-4162-a4f0-1cec8afd9f45" status: 409 len: 152 microversion: 2.1 time: 0.152814 Jan 17 21:23:16.096105 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 218/439] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jan 17 21:23:15 2022] DELETE /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments/9519e024-8d11-4162-a4f0-1cec8afd9f45 => generated 152 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 17 21:23:16.107532 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0d6425bd-1b80-4f76-944d-12d7ce8ced9f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:23:16.108089 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0d6425bd-1b80-4f76-944d-12d7ce8ced9f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:16.123909 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0d6425bd-1b80-4f76-944d-12d7ce8ced9f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:16.125044 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0d6425bd-1b80-4f76-944d-12d7ce8ced9f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:16.126599 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0d6425bd-1b80-4f76-944d-12d7ce8ced9f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:16.127054 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0d6425bd-1b80-4f76-944d-12d7ce8ced9f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:16.128092 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1966eacc-232d-4ba4-954a-9fd816d1f0c7 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:16.146716 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1966eacc-232d-4ba4-954a-9fd816d1f0c7 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.233649 Jan 17 21:23:16.157717 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 222/440] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:15 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:16.236284 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-90ee2b15-c3be-49bd-85fa-8fd04c4b8b14 req-63c375e0-682b-420d-90eb-0dedd7a844d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "053a2e02-abf9-46b4-9fbe-a257b05bf3fd", "tag": "fe07a20a-1b73-4844-9302-39928b39c888"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:23:16.237919 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:23:16.237919 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:23:16.253832 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-90ee2b15-c3be-49bd-85fa-8fd04c4b8b14 req-63c375e0-682b-420d-90eb-0dedd7a844d1 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:16.254603 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-90ee2b15-c3be-49bd-85fa-8fd04c4b8b14 req-63c375e0-682b-420d-90eb-0dedd7a844d1 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:16.269429 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0d6425bd-1b80-4f76-944d-12d7ce8ced9f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "POST /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/action" status: 202 len: 0 microversion: 2.1 time: 0.167320 Jan 17 21:23:16.273547 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 219/441] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:23:16 2022] POST /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:23:16.274067 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-90ee2b15-c3be-49bd-85fa-8fd04c4b8b14 req-63c375e0-682b-420d-90eb-0dedd7a844d1 service nova] Creating event network-changed:fe07a20a-1b73-4844-9302-39928b39c888 for instance 053a2e02-abf9-46b4-9fbe-a257b05bf3fd on hv-cinder-82489 Jan 17 21:23:16.281495 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-90ee2b15-c3be-49bd-85fa-8fd04c4b8b14 req-63c375e0-682b-420d-90eb-0dedd7a844d1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048638 Jan 17 21:23:16.282111 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 223/442] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:23:16.285687 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-20a1b358-941a-4467-a213-62e26c98452c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:16.286413 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-20a1b358-941a-4467-a213-62e26c98452c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:16.298748 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-20a1b358-941a-4467-a213-62e26c98452c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:16.299209 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-20a1b358-941a-4467-a213-62e26c98452c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:16.300011 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-20a1b358-941a-4467-a213-62e26c98452c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:16.300610 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-20a1b358-941a-4467-a213-62e26c98452c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:16.450618 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-20a1b358-941a-4467-a213-62e26c98452c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:16.463771 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-20a1b358-941a-4467-a213-62e26c98452c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1554 microversion: 2.1 time: 0.188497 Jan 17 21:23:16.464384 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 220/443] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:16 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:16.928571 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-153ecfa0-5bd2-42d6-a333-d4efb2ee7df9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:16.929991 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-153ecfa0-5bd2-42d6-a333-d4efb2ee7df9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:16.937734 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-153ecfa0-5bd2-42d6-a333-d4efb2ee7df9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:16.938216 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-153ecfa0-5bd2-42d6-a333-d4efb2ee7df9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:16.939435 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-153ecfa0-5bd2-42d6-a333-d4efb2ee7df9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:16.939934 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-153ecfa0-5bd2-42d6-a333-d4efb2ee7df9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:17.090284 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-153ecfa0-5bd2-42d6-a333-d4efb2ee7df9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:17.098867 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-153ecfa0-5bd2-42d6-a333-d4efb2ee7df9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1317 microversion: 2.1 time: 0.175255 Jan 17 21:23:17.109030 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 224/444] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:16 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:17.164894 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b719ac21-f51e-44a0-bfef-c1be5b12ed53 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:17.166409 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b719ac21-f51e-44a0-bfef-c1be5b12ed53 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:17.173370 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b719ac21-f51e-44a0-bfef-c1be5b12ed53 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:17.174325 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b719ac21-f51e-44a0-bfef-c1be5b12ed53 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:17.175237 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b719ac21-f51e-44a0-bfef-c1be5b12ed53 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:17.175783 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b719ac21-f51e-44a0-bfef-c1be5b12ed53 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:17.335276 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b719ac21-f51e-44a0-bfef-c1be5b12ed53 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:17.349281 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b719ac21-f51e-44a0-bfef-c1be5b12ed53 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.188397 Jan 17 21:23:17.351034 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 221/445] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:17 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:17.481233 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-34e6f953-c8dc-44d8-9914-a769248de7d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:17.482659 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-34e6f953-c8dc-44d8-9914-a769248de7d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:17.491407 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-34e6f953-c8dc-44d8-9914-a769248de7d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:17.492179 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-34e6f953-c8dc-44d8-9914-a769248de7d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:17.493165 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-34e6f953-c8dc-44d8-9914-a769248de7d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:17.493771 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-34e6f953-c8dc-44d8-9914-a769248de7d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:17.666898 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-34e6f953-c8dc-44d8-9914-a769248de7d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:17.677790 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-34e6f953-c8dc-44d8-9914-a769248de7d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1554 microversion: 2.1 time: 0.199484 Jan 17 21:23:17.680131 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 225/446] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:17 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1554 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:18.116016 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-faecf29f-3ed0-4ba8-94d0-f48d5f6ae21b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:18.116926 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-faecf29f-3ed0-4ba8-94d0-f48d5f6ae21b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:18.123027 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-faecf29f-3ed0-4ba8-94d0-f48d5f6ae21b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:18.123491 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-faecf29f-3ed0-4ba8-94d0-f48d5f6ae21b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:18.124292 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-faecf29f-3ed0-4ba8-94d0-f48d5f6ae21b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:18.124763 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-faecf29f-3ed0-4ba8-94d0-f48d5f6ae21b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:18.277611 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-faecf29f-3ed0-4ba8-94d0-f48d5f6ae21b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:18.285477 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-faecf29f-3ed0-4ba8-94d0-f48d5f6ae21b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1317 microversion: 2.1 time: 0.173136 Jan 17 21:23:18.293410 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 222/447] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:18 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:18.367793 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3a5ff9b1-a9c7-474a-b26a-ddfff7d0c74a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:18.369976 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3a5ff9b1-a9c7-474a-b26a-ddfff7d0c74a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:18.376638 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3a5ff9b1-a9c7-474a-b26a-ddfff7d0c74a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:18.377317 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3a5ff9b1-a9c7-474a-b26a-ddfff7d0c74a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:18.378116 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3a5ff9b1-a9c7-474a-b26a-ddfff7d0c74a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:18.378552 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3a5ff9b1-a9c7-474a-b26a-ddfff7d0c74a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:18.528573 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3a5ff9b1-a9c7-474a-b26a-ddfff7d0c74a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:18.536770 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3a5ff9b1-a9c7-474a-b26a-ddfff7d0c74a tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.173800 Jan 17 21:23:18.537340 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 226/448] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:18 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:18.700569 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ee3bfbcc-4b8c-4ff2-94e8-ccaa1283fef5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:18.701181 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ee3bfbcc-4b8c-4ff2-94e8-ccaa1283fef5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:18.708971 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ee3bfbcc-4b8c-4ff2-94e8-ccaa1283fef5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:18.709426 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ee3bfbcc-4b8c-4ff2-94e8-ccaa1283fef5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:18.710235 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ee3bfbcc-4b8c-4ff2-94e8-ccaa1283fef5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:18.711304 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ee3bfbcc-4b8c-4ff2-94e8-ccaa1283fef5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:18.904518 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ee3bfbcc-4b8c-4ff2-94e8-ccaa1283fef5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:18.912907 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ee3bfbcc-4b8c-4ff2-94e8-ccaa1283fef5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1554 microversion: 2.1 time: 0.215821 Jan 17 21:23:18.914003 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 223/449] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:18 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1554 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:19.302468 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-346078ef-cc78-42f2-8beb-60491223afc0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:19.303077 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-346078ef-cc78-42f2-8beb-60491223afc0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:19.309692 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-346078ef-cc78-42f2-8beb-60491223afc0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:19.310145 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-346078ef-cc78-42f2-8beb-60491223afc0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:19.310951 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-346078ef-cc78-42f2-8beb-60491223afc0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:19.311384 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-346078ef-cc78-42f2-8beb-60491223afc0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:19.453714 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-346078ef-cc78-42f2-8beb-60491223afc0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:19.461461 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-346078ef-cc78-42f2-8beb-60491223afc0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1317 microversion: 2.1 time: 0.162533 Jan 17 21:23:19.462081 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 227/450] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:19 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:19.554305 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4bd7ecbd-6187-4805-93df-e28553f61f5e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:19.556092 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4bd7ecbd-6187-4805-93df-e28553f61f5e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:19.562754 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4bd7ecbd-6187-4805-93df-e28553f61f5e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:19.563252 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4bd7ecbd-6187-4805-93df-e28553f61f5e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:19.564087 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4bd7ecbd-6187-4805-93df-e28553f61f5e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:19.564562 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4bd7ecbd-6187-4805-93df-e28553f61f5e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:19.725771 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4bd7ecbd-6187-4805-93df-e28553f61f5e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:19.738775 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4bd7ecbd-6187-4805-93df-e28553f61f5e tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.184645 Jan 17 21:23:19.738775 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 224/451] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:19 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:19.932154 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3fb3b597-2ac5-4d76-bac2-c845c1ca7bd9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:19.932849 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3fb3b597-2ac5-4d76-bac2-c845c1ca7bd9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:19.945881 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3fb3b597-2ac5-4d76-bac2-c845c1ca7bd9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:19.946511 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3fb3b597-2ac5-4d76-bac2-c845c1ca7bd9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:19.947570 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3fb3b597-2ac5-4d76-bac2-c845c1ca7bd9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:19.948009 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3fb3b597-2ac5-4d76-bac2-c845c1ca7bd9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:20.480018 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-70b6f85f-2ece-4f85-8cec-3c8262e6b30a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:20.480018 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-70b6f85f-2ece-4f85-8cec-3c8262e6b30a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:20.486276 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-70b6f85f-2ece-4f85-8cec-3c8262e6b30a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:20.487459 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-70b6f85f-2ece-4f85-8cec-3c8262e6b30a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:20.488758 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-70b6f85f-2ece-4f85-8cec-3c8262e6b30a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:20.489734 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-70b6f85f-2ece-4f85-8cec-3c8262e6b30a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:20.659370 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3fb3b597-2ac5-4d76-bac2-c845c1ca7bd9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:20.671730 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3fb3b597-2ac5-4d76-bac2-c845c1ca7bd9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1554 microversion: 2.1 time: 0.744092 Jan 17 21:23:20.672317 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 228/452] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:19 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1554 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:20.752759 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-498eb7dc-43ea-4b3f-9b6a-643722b11d4b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:20.753373 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-498eb7dc-43ea-4b3f-9b6a-643722b11d4b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:20.760331 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-498eb7dc-43ea-4b3f-9b6a-643722b11d4b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:20.760821 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-498eb7dc-43ea-4b3f-9b6a-643722b11d4b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:20.761624 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-498eb7dc-43ea-4b3f-9b6a-643722b11d4b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:20.762065 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-498eb7dc-43ea-4b3f-9b6a-643722b11d4b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:20.812661 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-70b6f85f-2ece-4f85-8cec-3c8262e6b30a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:20.824904 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-70b6f85f-2ece-4f85-8cec-3c8262e6b30a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1317 microversion: 2.1 time: 0.348440 Jan 17 21:23:20.829524 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 225/453] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:20 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:20.980226 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-498eb7dc-43ea-4b3f-9b6a-643722b11d4b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:20.994521 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-498eb7dc-43ea-4b3f-9b6a-643722b11d4b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1314 microversion: 2.1 time: 0.245125 Jan 17 21:23:20.996167 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 229/454] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:20 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:21.689080 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-cd05eb15-cf83-4d63-a663-b7a70756b24d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:21.689844 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-cd05eb15-cf83-4d63-a663-b7a70756b24d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:21.700546 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cd05eb15-cf83-4d63-a663-b7a70756b24d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:21.705541 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cd05eb15-cf83-4d63-a663-b7a70756b24d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:21.707014 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cd05eb15-cf83-4d63-a663-b7a70756b24d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:21.707639 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cd05eb15-cf83-4d63-a663-b7a70756b24d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:21.854701 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-de1de13e-84ef-494e-8b52-9de47dcecc9c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:21.859807 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-de1de13e-84ef-494e-8b52-9de47dcecc9c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:21.889395 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-de1de13e-84ef-494e-8b52-9de47dcecc9c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:21.890006 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-de1de13e-84ef-494e-8b52-9de47dcecc9c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:21.892898 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-de1de13e-84ef-494e-8b52-9de47dcecc9c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:21.894021 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-de1de13e-84ef-494e-8b52-9de47dcecc9c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:21.953585 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-cd05eb15-cf83-4d63-a663-b7a70756b24d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:21.973452 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-cd05eb15-cf83-4d63-a663-b7a70756b24d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1554 microversion: 2.1 time: 0.288080 Jan 17 21:23:21.974031 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 226/455] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:21 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1554 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:22.013056 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ad5136c1-f3f1-4f3a-bdc8-5015269d7d63 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:22.013687 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ad5136c1-f3f1-4f3a-bdc8-5015269d7d63 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:22.022014 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ad5136c1-f3f1-4f3a-bdc8-5015269d7d63 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:22.026703 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ad5136c1-f3f1-4f3a-bdc8-5015269d7d63 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:22.030568 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ad5136c1-f3f1-4f3a-bdc8-5015269d7d63 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:22.031201 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ad5136c1-f3f1-4f3a-bdc8-5015269d7d63 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:22.184886 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-de1de13e-84ef-494e-8b52-9de47dcecc9c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:22.193908 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-de1de13e-84ef-494e-8b52-9de47dcecc9c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1317 microversion: 2.1 time: 0.351275 Jan 17 21:23:22.194400 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 230/456] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:21 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:22.245651 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ad5136c1-f3f1-4f3a-bdc8-5015269d7d63 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:22.278350 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ad5136c1-f3f1-4f3a-bdc8-5015269d7d63 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1464 microversion: 2.1 time: 0.269204 Jan 17 21:23:22.278940 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 227/457] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:22 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1464 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:23:22.370988 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b6e263b5-bbf4-4b73-ac45-09fe7ea09871 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:22.371750 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b6e263b5-bbf4-4b73-ac45-09fe7ea09871 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:22.380464 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b6e263b5-bbf4-4b73-ac45-09fe7ea09871 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:22.381369 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b6e263b5-bbf4-4b73-ac45-09fe7ea09871 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:22.382996 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b6e263b5-bbf4-4b73-ac45-09fe7ea09871 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:22.383684 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b6e263b5-bbf4-4b73-ac45-09fe7ea09871 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:22.430971 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b6e263b5-bbf4-4b73-ac45-09fe7ea09871 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Going to try to terminate instance {{(pid=116183) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:23:22.548529 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b6e263b5-bbf4-4b73-ac45-09fe7ea09871 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "DELETE /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 204 len: 0 microversion: 2.1 time: 0.214904 Jan 17 21:23:22.549377 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 231/458] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:23:22 2022] DELETE /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:23:22.558391 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-63bf487e-01d1-49bb-a4fb-8097045e7c3b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:22.559019 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-63bf487e-01d1-49bb-a4fb-8097045e7c3b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:22.566056 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63bf487e-01d1-49bb-a4fb-8097045e7c3b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:22.566782 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63bf487e-01d1-49bb-a4fb-8097045e7c3b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:22.567795 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63bf487e-01d1-49bb-a4fb-8097045e7c3b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:22.568244 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63bf487e-01d1-49bb-a4fb-8097045e7c3b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:22.732489 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-63bf487e-01d1-49bb-a4fb-8097045e7c3b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:22.744755 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-63bf487e-01d1-49bb-a4fb-8097045e7c3b tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1470 microversion: 2.1 time: 0.189785 Jan 17 21:23:22.746323 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 228/459] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:22 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:22.991262 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-734829e3-c658-48ec-9159-c773741b0c3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:22.992585 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-734829e3-c658-48ec-9159-c773741b0c3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:23.005840 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-734829e3-c658-48ec-9159-c773741b0c3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:23.006411 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-734829e3-c658-48ec-9159-c773741b0c3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:23.008152 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-734829e3-c658-48ec-9159-c773741b0c3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:23.008694 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-734829e3-c658-48ec-9159-c773741b0c3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:23.210889 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0325b7b0-4011-481e-a722-23605851e8de tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:23.211949 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0325b7b0-4011-481e-a722-23605851e8de tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:23.228607 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0325b7b0-4011-481e-a722-23605851e8de tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:23.229307 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0325b7b0-4011-481e-a722-23605851e8de tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:23.234511 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0325b7b0-4011-481e-a722-23605851e8de tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:23.236621 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0325b7b0-4011-481e-a722-23605851e8de tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:23.263198 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-734829e3-c658-48ec-9159-c773741b0c3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:23.272771 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-734829e3-c658-48ec-9159-c773741b0c3a tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1554 microversion: 2.1 time: 0.285772 Jan 17 21:23:23.283248 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 232/460] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:22 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1554 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:23.431641 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-0325b7b0-4011-481e-a722-23605851e8de tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:23.448865 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0325b7b0-4011-481e-a722-23605851e8de tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1317 microversion: 2.1 time: 0.241858 Jan 17 21:23:23.459148 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 229/461] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:23 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:23:23.762616 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-af927ed7-8118-46e6-b3fd-bc125ff67392 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:23.763597 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-af927ed7-8118-46e6-b3fd-bc125ff67392 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:23.770605 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-af927ed7-8118-46e6-b3fd-bc125ff67392 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:23.771347 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-af927ed7-8118-46e6-b3fd-bc125ff67392 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:23.772262 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-af927ed7-8118-46e6-b3fd-bc125ff67392 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:23.773850 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-af927ed7-8118-46e6-b3fd-bc125ff67392 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:23.955240 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-af927ed7-8118-46e6-b3fd-bc125ff67392 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:23.977857 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-af927ed7-8118-46e6-b3fd-bc125ff67392 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1470 microversion: 2.1 time: 0.220063 Jan 17 21:23:23.979306 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 233/462] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:23 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1470 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:24.290387 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-86970efd-716d-4a76-899b-984651677688 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:24.291811 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-86970efd-716d-4a76-899b-984651677688 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:24.300533 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-86970efd-716d-4a76-899b-984651677688 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:24.301225 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-86970efd-716d-4a76-899b-984651677688 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:24.302245 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-86970efd-716d-4a76-899b-984651677688 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:24.302889 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-86970efd-716d-4a76-899b-984651677688 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:24.466435 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-86970efd-716d-4a76-899b-984651677688 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:24.471242 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ffcb95a8-d658-4757-b526-b2f0ed35a5f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:24.473272 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ffcb95a8-d658-4757-b526-b2f0ed35a5f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:24.474847 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-86970efd-716d-4a76-899b-984651677688 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1554 microversion: 2.1 time: 0.188671 Jan 17 21:23:24.475409 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 230/463] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:24 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:24.486580 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ffcb95a8-d658-4757-b526-b2f0ed35a5f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:24.487731 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ffcb95a8-d658-4757-b526-b2f0ed35a5f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:24.488586 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ffcb95a8-d658-4757-b526-b2f0ed35a5f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:24.489028 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ffcb95a8-d658-4757-b526-b2f0ed35a5f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:24.691264 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ffcb95a8-d658-4757-b526-b2f0ed35a5f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:24.702330 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ffcb95a8-d658-4757-b526-b2f0ed35a5f6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1317 microversion: 2.1 time: 0.237659 Jan 17 21:23:24.703232 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 234/464] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:24 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:24.996093 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c937e28d-1dde-48dd-a1d4-fe94fa66e7a4 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:24.996916 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c937e28d-1dde-48dd-a1d4-fe94fa66e7a4 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:25.003152 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c937e28d-1dde-48dd-a1d4-fe94fa66e7a4 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:25.003704 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c937e28d-1dde-48dd-a1d4-fe94fa66e7a4 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:25.005316 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c937e28d-1dde-48dd-a1d4-fe94fa66e7a4 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:25.005861 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c937e28d-1dde-48dd-a1d4-fe94fa66e7a4 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:25.170064 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c937e28d-1dde-48dd-a1d4-fe94fa66e7a4 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:25.178089 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c937e28d-1dde-48dd-a1d4-fe94fa66e7a4 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1470 microversion: 2.1 time: 0.186782 Jan 17 21:23:25.181551 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 231/465] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:24 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:25.502235 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7ee2cb78-6e94-446f-ab02-deff837d2f3e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:25.503538 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7ee2cb78-6e94-446f-ab02-deff837d2f3e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:25.511093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7ee2cb78-6e94-446f-ab02-deff837d2f3e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:25.512761 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7ee2cb78-6e94-446f-ab02-deff837d2f3e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:25.513926 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7ee2cb78-6e94-446f-ab02-deff837d2f3e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:25.514407 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7ee2cb78-6e94-446f-ab02-deff837d2f3e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:25.698594 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7ee2cb78-6e94-446f-ab02-deff837d2f3e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:25.706797 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7ee2cb78-6e94-446f-ab02-deff837d2f3e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1554 microversion: 2.1 time: 0.208364 Jan 17 21:23:25.707337 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 235/466] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:25 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1554 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:25.720061 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-67e1f29d-af72-4989-9bf0-fa2263bff445 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:25.720688 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-67e1f29d-af72-4989-9bf0-fa2263bff445 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:25.727850 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-67e1f29d-af72-4989-9bf0-fa2263bff445 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:25.728631 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-67e1f29d-af72-4989-9bf0-fa2263bff445 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:25.730320 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-67e1f29d-af72-4989-9bf0-fa2263bff445 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:25.730972 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-67e1f29d-af72-4989-9bf0-fa2263bff445 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:25.893208 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-67e1f29d-af72-4989-9bf0-fa2263bff445 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:25.908998 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-67e1f29d-af72-4989-9bf0-fa2263bff445 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1317 microversion: 2.1 time: 0.192280 Jan 17 21:23:25.909987 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 232/467] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:25 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:26.065757 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-85ad733e-2094-4a56-88c6-e3acaccd8f02 req-f199ba90-1b15-4a73-a5ac-359a2fa92aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722796bd-49c1-4a74-9f3c-f9ea7863440c", "name": "network-vif-deleted", "tag": "b7b6c108-ba5a-4fa7-98f2-021e2ac61686"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:23:26.067388 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:23:26.067388 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:23:26.083373 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-85ad733e-2094-4a56-88c6-e3acaccd8f02 req-f199ba90-1b15-4a73-a5ac-359a2fa92aef service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:26.084357 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-85ad733e-2094-4a56-88c6-e3acaccd8f02 req-f199ba90-1b15-4a73-a5ac-359a2fa92aef service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:26.098455 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-85ad733e-2094-4a56-88c6-e3acaccd8f02 req-f199ba90-1b15-4a73-a5ac-359a2fa92aef service nova] Creating event network-vif-deleted:b7b6c108-ba5a-4fa7-98f2-021e2ac61686 for instance 722796bd-49c1-4a74-9f3c-f9ea7863440c on hv-cinder-82489 Jan 17 21:23:26.106030 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-85ad733e-2094-4a56-88c6-e3acaccd8f02 req-f199ba90-1b15-4a73-a5ac-359a2fa92aef service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041420 Jan 17 21:23:26.106030 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 236/468] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:26.197814 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8a1e0a02-b125-489b-8ce6-149e2392f108 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:26.198687 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8a1e0a02-b125-489b-8ce6-149e2392f108 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:26.205815 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8a1e0a02-b125-489b-8ce6-149e2392f108 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:26.206265 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8a1e0a02-b125-489b-8ce6-149e2392f108 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:26.207604 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8a1e0a02-b125-489b-8ce6-149e2392f108 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:26.208460 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8a1e0a02-b125-489b-8ce6-149e2392f108 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:26.303101 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-8a1e0a02-b125-489b-8ce6-149e2392f108 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ebb65edde04b8194dcce87fe07bf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc45770b23744f5bd0562e2a9210890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:26.318352 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8a1e0a02-b125-489b-8ce6-149e2392f108 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 200 len: 1299 microversion: 2.1 time: 0.125021 Jan 17 21:23:26.318927 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 233/469] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:26 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:26.706977 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a159e9bb-34f3-48b6-848d-2a856848c663 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "192f4ecc-e316-40fc-b454-63cf15098e5c", "device": "/dev/sdb"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:23:26.710928 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a159e9bb-34f3-48b6-848d-2a856848c663 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:26.716846 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a159e9bb-34f3-48b6-848d-2a856848c663 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:26.717693 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a159e9bb-34f3-48b6-848d-2a856848c663 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:26.718556 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a159e9bb-34f3-48b6-848d-2a856848c663 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:26.718996 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a159e9bb-34f3-48b6-848d-2a856848c663 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:26.728014 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-992e76f4-b923-4d51-81f8-22498e0ca7bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:26.728990 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-992e76f4-b923-4d51-81f8-22498e0ca7bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:26.741017 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-992e76f4-b923-4d51-81f8-22498e0ca7bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:26.741744 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-992e76f4-b923-4d51-81f8-22498e0ca7bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:26.743231 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-992e76f4-b923-4d51-81f8-22498e0ca7bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:26.744050 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-992e76f4-b923-4d51-81f8-22498e0ca7bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:26.917447 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-992e76f4-b923-4d51-81f8-22498e0ca7bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:26.936491 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-992e76f4-b923-4d51-81f8-22498e0ca7bb tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1554 microversion: 2.1 time: 0.213868 Jan 17 21:23:26.937090 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 234/470] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:26 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:23:26.941598 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8468f521-6ece-452b-a46d-d36a0a15cd74 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:26.942555 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8468f521-6ece-452b-a46d-d36a0a15cd74 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:26.949708 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8468f521-6ece-452b-a46d-d36a0a15cd74 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:26.950133 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8468f521-6ece-452b-a46d-d36a0a15cd74 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:26.950983 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8468f521-6ece-452b-a46d-d36a0a15cd74 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:26.951403 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8468f521-6ece-452b-a46d-d36a0a15cd74 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:27.075487 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a159e9bb-34f3-48b6-848d-2a856848c663 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "POST /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372497 Jan 17 21:23:27.076312 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 237/471] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jan 17 21:23:26 2022] POST /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:27.127568 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-8468f521-6ece-452b-a46d-d36a0a15cd74 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:27.135421 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8468f521-6ece-452b-a46d-d36a0a15cd74 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1317 microversion: 2.1 time: 0.197241 Jan 17 21:23:27.145563 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 235/472] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:26 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:27.344552 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-14f2c607-884c-4e1d-82bd-cceb979d72c0 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:27.345245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-14f2c607-884c-4e1d-82bd-cceb979d72c0 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] [instance: 722796bd-49c1-4a74-9f3c-f9ea7863440c] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:27.351353 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-14f2c607-884c-4e1d-82bd-cceb979d72c0 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:27.351800 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-14f2c607-884c-4e1d-82bd-cceb979d72c0 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:27.352643 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-14f2c607-884c-4e1d-82bd-cceb979d72c0 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:27.353084 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-14f2c607-884c-4e1d-82bd-cceb979d72c0 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:27.366176 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-14f2c607-884c-4e1d-82bd-cceb979d72c0 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] HTTP exception thrown: Instance 722796bd-49c1-4a74-9f3c-f9ea7863440c could not be found. Jan 17 21:23:27.367272 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-14f2c607-884c-4e1d-82bd-cceb979d72c0 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] Returning 404 to user: Instance 722796bd-49c1-4a74-9f3c-f9ea7863440c could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:23:27.368083 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-14f2c607-884c-4e1d-82bd-cceb979d72c0 tempest-VolumesNegativeTest-1587958750 tempest-VolumesNegativeTest-1587958750-project] 10.222.0.64 "GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c" status: 404 len: 111 microversion: 2.1 time: 0.028044 Jan 17 21:23:27.368628 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 238/473] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:27 2022] GET /compute/v2.1/servers/722796bd-49c1-4a74-9f3c-f9ea7863440c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:23:27.955586 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8777eca4-48a6-40f0-bba4-f0b622ddb3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:27.956325 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8777eca4-48a6-40f0-bba4-f0b622ddb3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:27.964428 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8777eca4-48a6-40f0-bba4-f0b622ddb3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:27.964741 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8777eca4-48a6-40f0-bba4-f0b622ddb3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:27.965872 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8777eca4-48a6-40f0-bba4-f0b622ddb3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:27.966672 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8777eca4-48a6-40f0-bba4-f0b622ddb3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:28.154532 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a119afe7-103f-4f83-8099-487b7becd649 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:28.155361 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a119afe7-103f-4f83-8099-487b7becd649 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:28.168258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a119afe7-103f-4f83-8099-487b7becd649 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:28.168930 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a119afe7-103f-4f83-8099-487b7becd649 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:28.169856 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-8777eca4-48a6-40f0-bba4-f0b622ddb3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:28.170110 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a119afe7-103f-4f83-8099-487b7becd649 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:28.170714 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a119afe7-103f-4f83-8099-487b7becd649 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:28.199352 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8777eca4-48a6-40f0-bba4-f0b622ddb3b9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1560 microversion: 2.1 time: 0.247641 Jan 17 21:23:28.201865 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 236/474] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:27 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1560 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:28.359024 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fec53d58-a601-4e8f-8eb9-11db93b46a86 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:28.359510 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fec53d58-a601-4e8f-8eb9-11db93b46a86 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:28.367293 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fec53d58-a601-4e8f-8eb9-11db93b46a86 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:28.367767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fec53d58-a601-4e8f-8eb9-11db93b46a86 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:28.368600 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fec53d58-a601-4e8f-8eb9-11db93b46a86 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:28.369091 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fec53d58-a601-4e8f-8eb9-11db93b46a86 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:28.384271 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-a119afe7-103f-4f83-8099-487b7becd649 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:28.397139 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a119afe7-103f-4f83-8099-487b7becd649 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1317 microversion: 2.1 time: 0.246132 Jan 17 21:23:28.399217 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 239/475] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:28 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:23:28.497762 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-fec53d58-a601-4e8f-8eb9-11db93b46a86 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lazy-loading 'services' on Instance uuid 8a5818e4-0026-4597-9ef3-d539c2cdee97 {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:23:28.598046 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fec53d58-a601-4e8f-8eb9-11db93b46a86 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments/9519e024-8d11-4162-a4f0-1cec8afd9f45" status: 202 len: 0 microversion: 2.1 time: 0.242492 Jan 17 21:23:28.599778 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 237/476] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jan 17 21:23:28 2022] DELETE /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments/9519e024-8d11-4162-a4f0-1cec8afd9f45 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:23:28.607940 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7aab6a52-95af-4d12-bd28-edaf1efa86b3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:28.608943 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7aab6a52-95af-4d12-bd28-edaf1efa86b3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:28.614812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7aab6a52-95af-4d12-bd28-edaf1efa86b3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:28.615447 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7aab6a52-95af-4d12-bd28-edaf1efa86b3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:28.617082 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7aab6a52-95af-4d12-bd28-edaf1efa86b3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:28.617683 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7aab6a52-95af-4d12-bd28-edaf1efa86b3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:28.667109 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7aab6a52-95af-4d12-bd28-edaf1efa86b3 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062634 Jan 17 21:23:28.668093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 240/477] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:28 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:29.416029 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-202f01da-7a00-4486-8cfc-f319592df9ac tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:29.416771 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-202f01da-7a00-4486-8cfc-f319592df9ac tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:29.423005 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-202f01da-7a00-4486-8cfc-f319592df9ac tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:29.423619 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-202f01da-7a00-4486-8cfc-f319592df9ac tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:29.424946 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-202f01da-7a00-4486-8cfc-f319592df9ac tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:29.425396 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-202f01da-7a00-4486-8cfc-f319592df9ac tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:29.578479 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-202f01da-7a00-4486-8cfc-f319592df9ac tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:29.587228 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-202f01da-7a00-4486-8cfc-f319592df9ac tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1317 microversion: 2.1 time: 0.176345 Jan 17 21:23:29.588119 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 238/478] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:29 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:29.678430 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-47490385-6bbb-4533-8b74-f93666229f1f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:29.679936 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-47490385-6bbb-4533-8b74-f93666229f1f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:29.686331 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-47490385-6bbb-4533-8b74-f93666229f1f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:29.686787 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-47490385-6bbb-4533-8b74-f93666229f1f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:29.687871 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-47490385-6bbb-4533-8b74-f93666229f1f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:29.688550 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-47490385-6bbb-4533-8b74-f93666229f1f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:29.719349 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-47490385-6bbb-4533-8b74-f93666229f1f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044578 Jan 17 21:23:29.720286 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 241/479] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:29 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:30.230969 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-db21b753-0975-4c5e-8ac6-d8bf88df0497 req-a4118c9a-89cb-4a4d-919d-279898118d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053a2e02-abf9-46b4-9fbe-a257b05bf3fd", "name": "network-vif-plugged", "status": "completed", "tag": "fe07a20a-1b73-4844-9302-39928b39c888"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:23:30.232939 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:23:30.232939 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:23:30.242310 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-db21b753-0975-4c5e-8ac6-d8bf88df0497 req-a4118c9a-89cb-4a4d-919d-279898118d42 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:30.242713 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-db21b753-0975-4c5e-8ac6-d8bf88df0497 req-a4118c9a-89cb-4a4d-919d-279898118d42 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:30.257676 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-db21b753-0975-4c5e-8ac6-d8bf88df0497 req-a4118c9a-89cb-4a4d-919d-279898118d42 service nova] Creating event network-vif-plugged:fe07a20a-1b73-4844-9302-39928b39c888 for instance 053a2e02-abf9-46b4-9fbe-a257b05bf3fd on hv-cinder-82489 Jan 17 21:23:30.266088 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-db21b753-0975-4c5e-8ac6-d8bf88df0497 req-a4118c9a-89cb-4a4d-919d-279898118d42 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037000 Jan 17 21:23:30.267337 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 239/480] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:30.604081 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3a316409-790e-4ef3-ad89-a62c90a27387 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:30.604721 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3a316409-790e-4ef3-ad89-a62c90a27387 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:30.610880 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3a316409-790e-4ef3-ad89-a62c90a27387 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:30.611331 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3a316409-790e-4ef3-ad89-a62c90a27387 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:30.612215 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3a316409-790e-4ef3-ad89-a62c90a27387 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:30.612615 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3a316409-790e-4ef3-ad89-a62c90a27387 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:30.731643 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-03d3f0af-8689-4461-a03e-2a1249276050 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:30.732678 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-03d3f0af-8689-4461-a03e-2a1249276050 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:30.740051 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03d3f0af-8689-4461-a03e-2a1249276050 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:30.740550 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03d3f0af-8689-4461-a03e-2a1249276050 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:30.741401 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03d3f0af-8689-4461-a03e-2a1249276050 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:30.741845 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03d3f0af-8689-4461-a03e-2a1249276050 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:30.777019 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-03d3f0af-8689-4461-a03e-2a1249276050 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049584 Jan 17 21:23:30.781062 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 240/481] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:30 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:23:30.790044 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3a316409-790e-4ef3-ad89-a62c90a27387 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:30.794138 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3a316409-790e-4ef3-ad89-a62c90a27387 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1317 microversion: 2.1 time: 0.193712 Jan 17 21:23:30.801546 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 242/482] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:30 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:31.787234 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6a6c1250-6dea-41be-b6da-abc6c31eef56 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:31.788689 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6a6c1250-6dea-41be-b6da-abc6c31eef56 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:31.794830 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6a6c1250-6dea-41be-b6da-abc6c31eef56 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:31.795278 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6a6c1250-6dea-41be-b6da-abc6c31eef56 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:31.796869 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6a6c1250-6dea-41be-b6da-abc6c31eef56 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:31.797366 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6a6c1250-6dea-41be-b6da-abc6c31eef56 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:31.810125 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6ac58a5e-56c9-4c85-9d76-d638353c398a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:31.811290 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6ac58a5e-56c9-4c85-9d76-d638353c398a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:31.817685 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6ac58a5e-56c9-4c85-9d76-d638353c398a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:31.818133 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6ac58a5e-56c9-4c85-9d76-d638353c398a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:31.818919 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6ac58a5e-56c9-4c85-9d76-d638353c398a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:31.819378 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6ac58a5e-56c9-4c85-9d76-d638353c398a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:31.842907 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6a6c1250-6dea-41be-b6da-abc6c31eef56 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059072 Jan 17 21:23:31.843434 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 241/483] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:31 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:31.973227 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6ac58a5e-56c9-4c85-9d76-d638353c398a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:31.992756 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6ac58a5e-56c9-4c85-9d76-d638353c398a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1317 microversion: 2.1 time: 0.185771 Jan 17 21:23:31.999855 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 243/484] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:31 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:32.858860 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2890804e-b5f1-49ec-a986-83baddba8645 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:32.859905 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2890804e-b5f1-49ec-a986-83baddba8645 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:32.866672 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2890804e-b5f1-49ec-a986-83baddba8645 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:32.867349 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2890804e-b5f1-49ec-a986-83baddba8645 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:32.868217 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2890804e-b5f1-49ec-a986-83baddba8645 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:32.868756 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2890804e-b5f1-49ec-a986-83baddba8645 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:32.914541 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2890804e-b5f1-49ec-a986-83baddba8645 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061401 Jan 17 21:23:32.915863 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 242/485] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:32 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:33.019538 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a5b55503-1f51-4ed3-b6ae-7dd2a127b6d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:33.020907 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a5b55503-1f51-4ed3-b6ae-7dd2a127b6d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:33.030547 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a5b55503-1f51-4ed3-b6ae-7dd2a127b6d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:33.031005 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a5b55503-1f51-4ed3-b6ae-7dd2a127b6d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:33.035809 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a5b55503-1f51-4ed3-b6ae-7dd2a127b6d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:33.036484 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a5b55503-1f51-4ed3-b6ae-7dd2a127b6d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:33.225045 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-a5b55503-1f51-4ed3-b6ae-7dd2a127b6d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:33.234447 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a5b55503-1f51-4ed3-b6ae-7dd2a127b6d9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1508 microversion: 2.1 time: 0.217862 Jan 17 21:23:33.235467 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 244/486] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:33 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:33.925880 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0cb97e96-e208-44b1-b8fb-dd289763bb1d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:33.927394 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0cb97e96-e208-44b1-b8fb-dd289763bb1d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:33.938781 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0cb97e96-e208-44b1-b8fb-dd289763bb1d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:33.939567 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0cb97e96-e208-44b1-b8fb-dd289763bb1d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:33.942500 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0cb97e96-e208-44b1-b8fb-dd289763bb1d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:33.943184 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0cb97e96-e208-44b1-b8fb-dd289763bb1d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:34.021736 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0cb97e96-e208-44b1-b8fb-dd289763bb1d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099534 Jan 17 21:23:34.022868 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 243/487] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:33 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:34.727888 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-19c86240-1abc-400a-8470-ac52f95f0b52 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a9561b3-41c1-4b66-bc89-beeed00e3264"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:23:34.729730 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-19c86240-1abc-400a-8470-ac52f95f0b52 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:34.751494 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-19c86240-1abc-400a-8470-ac52f95f0b52 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:34.755245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-19c86240-1abc-400a-8470-ac52f95f0b52 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:34.756451 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-19c86240-1abc-400a-8470-ac52f95f0b52 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:34.773729 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-19c86240-1abc-400a-8470-ac52f95f0b52 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:35.034263 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d3933a9f-bcd3-4ea0-8d91-db185700b07d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:35.035742 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d3933a9f-bcd3-4ea0-8d91-db185700b07d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:35.052348 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d3933a9f-bcd3-4ea0-8d91-db185700b07d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:35.055501 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d3933a9f-bcd3-4ea0-8d91-db185700b07d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:35.056958 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d3933a9f-bcd3-4ea0-8d91-db185700b07d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:35.057394 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d3933a9f-bcd3-4ea0-8d91-db185700b07d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:35.158489 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d3933a9f-bcd3-4ea0-8d91-db185700b07d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123116 Jan 17 21:23:35.164441 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 244/488] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:35 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:35.499202 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-19c86240-1abc-400a-8470-ac52f95f0b52 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "POST /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.777668 Jan 17 21:23:35.500421 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 245/489] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jan 17 21:23:34 2022] POST /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 194 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:36.175085 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0cb2555d-f02a-44b4-b68e-0301e64eb6e9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:36.180593 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0cb2555d-f02a-44b4-b68e-0301e64eb6e9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:36.196568 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0cb2555d-f02a-44b4-b68e-0301e64eb6e9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:36.197450 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0cb2555d-f02a-44b4-b68e-0301e64eb6e9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:36.199990 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0cb2555d-f02a-44b4-b68e-0301e64eb6e9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:36.201785 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0cb2555d-f02a-44b4-b68e-0301e64eb6e9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:36.268900 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0cb2555d-f02a-44b4-b68e-0301e64eb6e9 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097404 Jan 17 21:23:36.271311 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 245/490] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:36 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:23:47.227578 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-adafc681-b625-4d1d-8df8-be0c31495177 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Action: 'create', calling method: .version_select at 0x7f8976a67040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1095543640"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:23:47.267844 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-adafc681-b625-4d1d-8df8-be0c31495177 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Getting quotas for project 715ec979393344e694cfdd0eab44cb1c. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:23:47.274085 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-adafc681-b625-4d1d-8df8-be0c31495177 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Getting quotas for user 335e9c01fa8345f4bf1e14cce86abb2c and project 715ec979393344e694cfdd0eab44cb1c. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:23:47.622124 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-adafc681-b625-4d1d-8df8-be0c31495177 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Getting quotas for project 715ec979393344e694cfdd0eab44cb1c. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:23:47.626457 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-adafc681-b625-4d1d-8df8-be0c31495177 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Getting quotas for user 335e9c01fa8345f4bf1e14cce86abb2c and project 715ec979393344e694cfdd0eab44cb1c. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:23:47.644420 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-adafc681-b625-4d1d-8df8-be0c31495177 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.760864 Jan 17 21:23:47.651069 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 246/491] 10.222.0.64 () {60 vars in 1157 bytes} [Mon Jan 17 21:23:46 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:48.627224 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4400984b-2639-40f7-acf5-ae4b630e6a0a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Action: 'create', calling method: .version_select at 0x7f897699d790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-577368355"}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:23:48.675423 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-4400984b-2639-40f7-acf5-ae4b630e6a0a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Getting quotas for project 97b00002d33945c6a8056483b241fbf6. Resources: {'key_pairs'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:23:48.683193 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-4400984b-2639-40f7-acf5-ae4b630e6a0a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Getting quotas for user 0cd489955c19471891724ec1badc11ee and project 97b00002d33945c6a8056483b241fbf6. Resources: {'key_pairs'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:23:49.036171 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-4400984b-2639-40f7-acf5-ae4b630e6a0a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Getting quotas for project 97b00002d33945c6a8056483b241fbf6. Resources: {'key_pairs'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:23:49.047938 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-4400984b-2639-40f7-acf5-ae4b630e6a0a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Getting quotas for user 0cd489955c19471891724ec1badc11ee and project 97b00002d33945c6a8056483b241fbf6. Resources: {'key_pairs'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:23:49.085600 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4400984b-2639-40f7-acf5-ae4b630e6a0a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.716955 Jan 17 21:23:49.087085 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 246/492] 10.222.0.64 () {60 vars in 1157 bytes} [Mon Jan 17 21:23:48 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:54.252444 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4c526cd7-e1bb-434c-8967-475ae438bb79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a9561b3-41c1-4b66-bc89-beeed00e3264"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:23:54.254607 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4c526cd7-e1bb-434c-8967-475ae438bb79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:54.266151 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c526cd7-e1bb-434c-8967-475ae438bb79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:54.266625 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c526cd7-e1bb-434c-8967-475ae438bb79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:54.269611 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c526cd7-e1bb-434c-8967-475ae438bb79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:54.270142 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c526cd7-e1bb-434c-8967-475ae438bb79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:54.277571 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5e5dcd29-4f23-42dd-8954-b1f5bae682f1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:54.278079 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5e5dcd29-4f23-42dd-8954-b1f5bae682f1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:54.289156 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5e5dcd29-4f23-42dd-8954-b1f5bae682f1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:54.289929 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5e5dcd29-4f23-42dd-8954-b1f5bae682f1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:54.290962 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5e5dcd29-4f23-42dd-8954-b1f5bae682f1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:54.291604 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5e5dcd29-4f23-42dd-8954-b1f5bae682f1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:54.329398 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5e5dcd29-4f23-42dd-8954-b1f5bae682f1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Going to try to terminate instance {{(pid=116182) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:23:54.402822 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-4c526cd7-e1bb-434c-8967-475ae438bb79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] HTTP exception thrown: Invalid volume: volume 1a9561b3-41c1-4b66-bc89-beeed00e3264 is already attached to instances: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd Jan 17 21:23:54.403812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4c526cd7-e1bb-434c-8967-475ae438bb79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Returning 400 to user: Invalid volume: volume 1a9561b3-41c1-4b66-bc89-beeed00e3264 is already attached to instances: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:23:54.404973 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4c526cd7-e1bb-434c-8967-475ae438bb79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "POST /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.168888 Jan 17 21:23:54.406841 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 247/493] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jan 17 21:23:54 2022] POST /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 174 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 17 21:23:54.439114 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5e5dcd29-4f23-42dd-8954-b1f5bae682f1 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 204 len: 0 microversion: 2.1 time: 0.167156 Jan 17 21:23:54.443959 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 247/494] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:23:54 2022] DELETE /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 17 21:23:54.450575 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-31f0d174-d1d2-4117-8b7c-ca10587906fc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:54.451193 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-31f0d174-d1d2-4117-8b7c-ca10587906fc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:54.463503 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-31f0d174-d1d2-4117-8b7c-ca10587906fc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:54.463933 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-31f0d174-d1d2-4117-8b7c-ca10587906fc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:54.465415 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-31f0d174-d1d2-4117-8b7c-ca10587906fc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:54.465867 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-31f0d174-d1d2-4117-8b7c-ca10587906fc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:54.493746 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e3d07ad4-99e4-4171-9a4b-5e711202a584 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:54.494594 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e3d07ad4-99e4-4171-9a4b-5e711202a584 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:54.504181 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e3d07ad4-99e4-4171-9a4b-5e711202a584 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:54.504842 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e3d07ad4-99e4-4171-9a4b-5e711202a584 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:54.506493 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e3d07ad4-99e4-4171-9a4b-5e711202a584 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:54.507295 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e3d07ad4-99e4-4171-9a4b-5e711202a584 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:54.619439 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-e3d07ad4-99e4-4171-9a4b-5e711202a584 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lazy-loading 'services' on Instance uuid 053a2e02-abf9-46b4-9fbe-a257b05bf3fd {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:23:54.645695 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-31f0d174-d1d2-4117-8b7c-ca10587906fc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:54.655375 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-31f0d174-d1d2-4117-8b7c-ca10587906fc tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.210109 Jan 17 21:23:54.656752 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 248/495] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:54 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:54.714010 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e3d07ad4-99e4-4171-9a4b-5e711202a584 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "DELETE /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments/1a9561b3-41c1-4b66-bc89-beeed00e3264" status: 202 len: 0 microversion: 2.1 time: 0.226790 Jan 17 21:23:54.714906 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 248/496] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jan 17 21:23:54 2022] DELETE /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments/1a9561b3-41c1-4b66-bc89-beeed00e3264 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:23:54.724448 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-abd6b36a-0216-43e4-99d3-6a5e6f2db743 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:54.725849 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-abd6b36a-0216-43e4-99d3-6a5e6f2db743 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:54.734208 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-abd6b36a-0216-43e4-99d3-6a5e6f2db743 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:54.734604 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-abd6b36a-0216-43e4-99d3-6a5e6f2db743 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:54.735980 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-abd6b36a-0216-43e4-99d3-6a5e6f2db743 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:54.736494 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-abd6b36a-0216-43e4-99d3-6a5e6f2db743 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:54.775496 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-abd6b36a-0216-43e4-99d3-6a5e6f2db743 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055892 Jan 17 21:23:54.776310 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 249/497] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:54 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:55.674054 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-579776d2-22a4-4637-bcf6-d2ef5a478d8c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:55.674926 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-579776d2-22a4-4637-bcf6-d2ef5a478d8c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:55.683558 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-579776d2-22a4-4637-bcf6-d2ef5a478d8c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:55.684324 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-579776d2-22a4-4637-bcf6-d2ef5a478d8c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:55.685392 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-579776d2-22a4-4637-bcf6-d2ef5a478d8c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:55.686049 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-579776d2-22a4-4637-bcf6-d2ef5a478d8c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:55.787130 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4cd7cca7-b7e4-417e-95a1-e81df5976be6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:55.788722 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4cd7cca7-b7e4-417e-95a1-e81df5976be6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:55.795810 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4cd7cca7-b7e4-417e-95a1-e81df5976be6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:55.796551 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4cd7cca7-b7e4-417e-95a1-e81df5976be6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:55.797370 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4cd7cca7-b7e4-417e-95a1-e81df5976be6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:55.797999 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4cd7cca7-b7e4-417e-95a1-e81df5976be6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:55.830814 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4cd7cca7-b7e4-417e-95a1-e81df5976be6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047469 Jan 17 21:23:55.832006 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 250/498] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:55 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:23:55.845803 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-579776d2-22a4-4637-bcf6-d2ef5a478d8c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:55.853051 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-579776d2-22a4-4637-bcf6-d2ef5a478d8c tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.183092 Jan 17 21:23:55.853717 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 249/499] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:55 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:56.841674 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e54f8696-e3c6-45aa-9517-4087664a4040 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:56.842583 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-e54f8696-e3c6-45aa-9517-4087664a4040 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:56.848876 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e54f8696-e3c6-45aa-9517-4087664a4040 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:56.849330 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e54f8696-e3c6-45aa-9517-4087664a4040 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:56.850721 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e54f8696-e3c6-45aa-9517-4087664a4040 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:56.851165 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e54f8696-e3c6-45aa-9517-4087664a4040 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:56.870492 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0650c79f-300f-43d4-bef8-16f9ab1c07ef tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:56.871137 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0650c79f-300f-43d4-bef8-16f9ab1c07ef tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:56.878154 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0650c79f-300f-43d4-bef8-16f9ab1c07ef tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:56.878615 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0650c79f-300f-43d4-bef8-16f9ab1c07ef tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:56.879410 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0650c79f-300f-43d4-bef8-16f9ab1c07ef tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:56.879853 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0650c79f-300f-43d4-bef8-16f9ab1c07ef tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:56.881272 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e54f8696-e3c6-45aa-9517-4087664a4040 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043574 Jan 17 21:23:56.881843 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 251/500] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:56 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:57.024669 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-0650c79f-300f-43d4-bef8-16f9ab1c07ef tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:57.033016 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0650c79f-300f-43d4-bef8-16f9ab1c07ef tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.166072 Jan 17 21:23:57.033582 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 250/501] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:56 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:23:57.893217 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-41cce480-a618-4a94-b80f-f5100484284a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:57.894119 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-41cce480-a618-4a94-b80f-f5100484284a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:57.900610 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-41cce480-a618-4a94-b80f-f5100484284a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:57.901058 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-41cce480-a618-4a94-b80f-f5100484284a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:57.901840 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-41cce480-a618-4a94-b80f-f5100484284a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:57.902276 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-41cce480-a618-4a94-b80f-f5100484284a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:57.934020 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-41cce480-a618-4a94-b80f-f5100484284a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044546 Jan 17 21:23:57.934574 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 252/502] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:57 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:58.049683 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-177385dc-6c2a-4f3e-88a6-7f42ea252b10 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:58.050312 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-177385dc-6c2a-4f3e-88a6-7f42ea252b10 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:58.057389 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-177385dc-6c2a-4f3e-88a6-7f42ea252b10 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:58.057847 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-177385dc-6c2a-4f3e-88a6-7f42ea252b10 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:58.058651 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-177385dc-6c2a-4f3e-88a6-7f42ea252b10 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:58.059094 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-177385dc-6c2a-4f3e-88a6-7f42ea252b10 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:58.208011 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-177385dc-6c2a-4f3e-88a6-7f42ea252b10 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:58.217164 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-177385dc-6c2a-4f3e-88a6-7f42ea252b10 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.171124 Jan 17 21:23:58.217736 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 251/503] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:58 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:23:58.945982 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-75dff269-22f8-469e-8a77-54fa0d9499b4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:58.947061 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-75dff269-22f8-469e-8a77-54fa0d9499b4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:58.954365 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-75dff269-22f8-469e-8a77-54fa0d9499b4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:58.956257 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-75dff269-22f8-469e-8a77-54fa0d9499b4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:58.956257 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-75dff269-22f8-469e-8a77-54fa0d9499b4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:58.956257 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-75dff269-22f8-469e-8a77-54fa0d9499b4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:58.990080 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-75dff269-22f8-469e-8a77-54fa0d9499b4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048038 Jan 17 21:23:58.990645 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 253/504] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:58 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:23:59.234520 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b05366ef-cea0-4f59-8be1-c94c3de6e074 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:23:59.235526 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b05366ef-cea0-4f59-8be1-c94c3de6e074 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:23:59.241666 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b05366ef-cea0-4f59-8be1-c94c3de6e074 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:59.242127 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b05366ef-cea0-4f59-8be1-c94c3de6e074 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:59.242923 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b05366ef-cea0-4f59-8be1-c94c3de6e074 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:23:59.243365 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b05366ef-cea0-4f59-8be1-c94c3de6e074 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:23:59.388425 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b05366ef-cea0-4f59-8be1-c94c3de6e074 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:23:59.395830 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b05366ef-cea0-4f59-8be1-c94c3de6e074 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.165069 Jan 17 21:23:59.397026 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 252/505] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:23:59 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:00.000848 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-94797df1-23d5-4f30-9bb1-70305f7bfd9a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:00.001883 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-94797df1-23d5-4f30-9bb1-70305f7bfd9a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:00.009331 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94797df1-23d5-4f30-9bb1-70305f7bfd9a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:00.009331 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94797df1-23d5-4f30-9bb1-70305f7bfd9a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:00.010707 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94797df1-23d5-4f30-9bb1-70305f7bfd9a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:00.011205 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94797df1-23d5-4f30-9bb1-70305f7bfd9a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:00.041206 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-94797df1-23d5-4f30-9bb1-70305f7bfd9a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044072 Jan 17 21:24:00.041789 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 254/506] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:23:59 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:00.413392 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-417eb577-dfe4-45a1-9f68-1d362ad5c3af tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:00.414000 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-417eb577-dfe4-45a1-9f68-1d362ad5c3af tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:00.420815 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-417eb577-dfe4-45a1-9f68-1d362ad5c3af tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:00.421264 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-417eb577-dfe4-45a1-9f68-1d362ad5c3af tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:00.422079 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-417eb577-dfe4-45a1-9f68-1d362ad5c3af tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:00.422489 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-417eb577-dfe4-45a1-9f68-1d362ad5c3af tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:00.556134 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-417eb577-dfe4-45a1-9f68-1d362ad5c3af tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:00.563442 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-417eb577-dfe4-45a1-9f68-1d362ad5c3af tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.153921 Jan 17 21:24:00.564018 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 253/507] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:00 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:01.053829 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-791d7cf9-7782-4d63-82cf-495632bfee31 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:01.055294 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-791d7cf9-7782-4d63-82cf-495632bfee31 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:01.061953 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-791d7cf9-7782-4d63-82cf-495632bfee31 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:01.062405 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-791d7cf9-7782-4d63-82cf-495632bfee31 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:01.063199 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-791d7cf9-7782-4d63-82cf-495632bfee31 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:01.063637 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-791d7cf9-7782-4d63-82cf-495632bfee31 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:01.093409 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-791d7cf9-7782-4d63-82cf-495632bfee31 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043936 Jan 17 21:24:01.093956 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 255/508] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:01 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:24:01.582153 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-bf48a64f-a8ca-4bd4-a10b-e9b38a3b9244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:01.583159 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-bf48a64f-a8ca-4bd4-a10b-e9b38a3b9244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:01.590324 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bf48a64f-a8ca-4bd4-a10b-e9b38a3b9244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:01.590784 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bf48a64f-a8ca-4bd4-a10b-e9b38a3b9244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:01.591618 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bf48a64f-a8ca-4bd4-a10b-e9b38a3b9244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:01.592065 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bf48a64f-a8ca-4bd4-a10b-e9b38a3b9244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:01.728597 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-bf48a64f-a8ca-4bd4-a10b-e9b38a3b9244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:01.739333 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-bf48a64f-a8ca-4bd4-a10b-e9b38a3b9244 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.158875 Jan 17 21:24:01.740047 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 254/509] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:01 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:02.104768 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-94ffdca4-b8fb-42c8-8dfb-ec70a792bacb tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:02.105811 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-94ffdca4-b8fb-42c8-8dfb-ec70a792bacb tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:02.112849 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94ffdca4-b8fb-42c8-8dfb-ec70a792bacb tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:02.113335 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94ffdca4-b8fb-42c8-8dfb-ec70a792bacb tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:02.114146 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94ffdca4-b8fb-42c8-8dfb-ec70a792bacb tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:02.114592 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94ffdca4-b8fb-42c8-8dfb-ec70a792bacb tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:02.145787 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-94ffdca4-b8fb-42c8-8dfb-ec70a792bacb tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044925 Jan 17 21:24:02.146340 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 256/510] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:02 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:02.757192 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5cc782ef-1b6e-4138-a9a6-54f737375754 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:02.757820 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5cc782ef-1b6e-4138-a9a6-54f737375754 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:02.764908 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5cc782ef-1b6e-4138-a9a6-54f737375754 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:02.765371 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5cc782ef-1b6e-4138-a9a6-54f737375754 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:02.766172 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5cc782ef-1b6e-4138-a9a6-54f737375754 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:02.766641 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5cc782ef-1b6e-4138-a9a6-54f737375754 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:02.898438 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5cc782ef-1b6e-4138-a9a6-54f737375754 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:02.906009 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5cc782ef-1b6e-4138-a9a6-54f737375754 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.153113 Jan 17 21:24:02.906584 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 255/511] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:02 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:03.157064 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7f6cb78b-d23b-426c-a6c1-a74b41eb17e0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:03.157981 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7f6cb78b-d23b-426c-a6c1-a74b41eb17e0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:03.164267 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7f6cb78b-d23b-426c-a6c1-a74b41eb17e0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:03.164761 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7f6cb78b-d23b-426c-a6c1-a74b41eb17e0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:03.165556 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7f6cb78b-d23b-426c-a6c1-a74b41eb17e0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:03.166000 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7f6cb78b-d23b-426c-a6c1-a74b41eb17e0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:03.195631 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7f6cb78b-d23b-426c-a6c1-a74b41eb17e0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042229 Jan 17 21:24:03.196642 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 257/512] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:03 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:03.923817 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b91ccb51-aa28-469b-8b3a-cfe0e9330521 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:03.924456 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b91ccb51-aa28-469b-8b3a-cfe0e9330521 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:03.930848 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b91ccb51-aa28-469b-8b3a-cfe0e9330521 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:03.931313 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b91ccb51-aa28-469b-8b3a-cfe0e9330521 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:03.932106 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b91ccb51-aa28-469b-8b3a-cfe0e9330521 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:03.932584 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b91ccb51-aa28-469b-8b3a-cfe0e9330521 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:04.061050 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b91ccb51-aa28-469b-8b3a-cfe0e9330521 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:04.068283 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b91ccb51-aa28-469b-8b3a-cfe0e9330521 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.148288 Jan 17 21:24:04.068869 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 256/513] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:03 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:24:04.207054 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-08d3d942-cbf0-4de1-82ec-1047c99c0891 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:04.207876 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-08d3d942-cbf0-4de1-82ec-1047c99c0891 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:04.214494 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-08d3d942-cbf0-4de1-82ec-1047c99c0891 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:04.214946 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-08d3d942-cbf0-4de1-82ec-1047c99c0891 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:04.215725 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-08d3d942-cbf0-4de1-82ec-1047c99c0891 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:04.216167 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-08d3d942-cbf0-4de1-82ec-1047c99c0891 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:04.246082 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-08d3d942-cbf0-4de1-82ec-1047c99c0891 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042801 Jan 17 21:24:04.246647 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 258/514] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:04 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:05.085494 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-52b66219-f30b-4011-ad07-cd9275ff6f66 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:05.086144 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-52b66219-f30b-4011-ad07-cd9275ff6f66 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:05.092853 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-52b66219-f30b-4011-ad07-cd9275ff6f66 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:05.093310 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-52b66219-f30b-4011-ad07-cd9275ff6f66 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:05.094111 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-52b66219-f30b-4011-ad07-cd9275ff6f66 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:05.094558 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-52b66219-f30b-4011-ad07-cd9275ff6f66 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:05.234739 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-52b66219-f30b-4011-ad07-cd9275ff6f66 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:05.242271 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-52b66219-f30b-4011-ad07-cd9275ff6f66 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.160854 Jan 17 21:24:05.242767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 257/515] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:05 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:05.258159 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-56a4a554-90bf-4b87-9c8f-726b5e3e9185 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:05.259065 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-56a4a554-90bf-4b87-9c8f-726b5e3e9185 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:05.265414 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-56a4a554-90bf-4b87-9c8f-726b5e3e9185 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:05.265867 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-56a4a554-90bf-4b87-9c8f-726b5e3e9185 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:05.266654 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-56a4a554-90bf-4b87-9c8f-726b5e3e9185 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:05.267099 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-56a4a554-90bf-4b87-9c8f-726b5e3e9185 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:05.296887 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-56a4a554-90bf-4b87-9c8f-726b5e3e9185 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042871 Jan 17 21:24:05.297434 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 259/516] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:05 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:06.258514 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-47e9f4d1-4f4d-478c-be04-2f970d9c7cb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:06.259029 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-47e9f4d1-4f4d-478c-be04-2f970d9c7cb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:06.265442 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-47e9f4d1-4f4d-478c-be04-2f970d9c7cb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:06.265903 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-47e9f4d1-4f4d-478c-be04-2f970d9c7cb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:06.266690 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-47e9f4d1-4f4d-478c-be04-2f970d9c7cb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:06.267137 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-47e9f4d1-4f4d-478c-be04-2f970d9c7cb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:06.308576 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1966e447-1d8c-4097-9a7e-0616509b33dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:06.309491 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1966e447-1d8c-4097-9a7e-0616509b33dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:06.316095 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1966e447-1d8c-4097-9a7e-0616509b33dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:06.316595 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1966e447-1d8c-4097-9a7e-0616509b33dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:06.317528 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1966e447-1d8c-4097-9a7e-0616509b33dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:06.317974 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1966e447-1d8c-4097-9a7e-0616509b33dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:06.350210 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1966e447-1d8c-4097-9a7e-0616509b33dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Jan 17 21:24:06.350868 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 260/517] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:06 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:24:06.404704 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-47e9f4d1-4f4d-478c-be04-2f970d9c7cb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:06.411894 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-47e9f4d1-4f4d-478c-be04-2f970d9c7cb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.157196 Jan 17 21:24:06.412474 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 258/518] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:06 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:07.362276 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-39613cdd-32bd-48fb-88a1-a381889a3b79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:07.363094 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-39613cdd-32bd-48fb-88a1-a381889a3b79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:07.370827 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-39613cdd-32bd-48fb-88a1-a381889a3b79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:07.371282 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-39613cdd-32bd-48fb-88a1-a381889a3b79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:07.372078 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-39613cdd-32bd-48fb-88a1-a381889a3b79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:07.372557 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-39613cdd-32bd-48fb-88a1-a381889a3b79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:07.402720 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-39613cdd-32bd-48fb-88a1-a381889a3b79 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Jan 17 21:24:07.403279 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 261/519] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:07 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:24:07.429904 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0571a6b0-5708-43f7-bca0-148ef53c96ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:07.430520 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0571a6b0-5708-43f7-bca0-148ef53c96ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:07.436924 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0571a6b0-5708-43f7-bca0-148ef53c96ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:07.437383 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0571a6b0-5708-43f7-bca0-148ef53c96ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:07.438192 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0571a6b0-5708-43f7-bca0-148ef53c96ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:07.438796 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0571a6b0-5708-43f7-bca0-148ef53c96ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:07.582782 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-0571a6b0-5708-43f7-bca0-148ef53c96ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:07.590195 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0571a6b0-5708-43f7-bca0-148ef53c96ab tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.164704 Jan 17 21:24:07.590749 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 259/520] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:07 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:08.414165 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-36002f42-f12d-4ae0-99a0-1acf204fc0cb tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:08.415071 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-36002f42-f12d-4ae0-99a0-1acf204fc0cb tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:08.421340 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-36002f42-f12d-4ae0-99a0-1acf204fc0cb tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:08.421795 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-36002f42-f12d-4ae0-99a0-1acf204fc0cb tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:08.422578 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-36002f42-f12d-4ae0-99a0-1acf204fc0cb tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:08.423021 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-36002f42-f12d-4ae0-99a0-1acf204fc0cb tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:08.455191 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-36002f42-f12d-4ae0-99a0-1acf204fc0cb tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044803 Jan 17 21:24:08.455787 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 262/521] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:08 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:08.609013 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-caaa85c6-6d21-43b7-bac8-e81a71076870 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:08.609696 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-caaa85c6-6d21-43b7-bac8-e81a71076870 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:08.617396 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-caaa85c6-6d21-43b7-bac8-e81a71076870 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:08.617857 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-caaa85c6-6d21-43b7-bac8-e81a71076870 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:08.618697 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-caaa85c6-6d21-43b7-bac8-e81a71076870 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:08.619143 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-caaa85c6-6d21-43b7-bac8-e81a71076870 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:08.754157 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-caaa85c6-6d21-43b7-bac8-e81a71076870 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:08.763688 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-caaa85c6-6d21-43b7-bac8-e81a71076870 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.158443 Jan 17 21:24:08.764478 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 260/522] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:08 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:09.466812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4a7670b7-c3c0-4111-b81e-a99d3d59eab2 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:09.467725 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4a7670b7-c3c0-4111-b81e-a99d3d59eab2 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:09.474124 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a7670b7-c3c0-4111-b81e-a99d3d59eab2 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:09.474569 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a7670b7-c3c0-4111-b81e-a99d3d59eab2 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:09.475353 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a7670b7-c3c0-4111-b81e-a99d3d59eab2 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:09.475784 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a7670b7-c3c0-4111-b81e-a99d3d59eab2 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:09.504953 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4a7670b7-c3c0-4111-b81e-a99d3d59eab2 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042158 Jan 17 21:24:09.505505 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 263/523] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:09 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:09.779763 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2ff3ebab-08e4-45dd-a459-da8bdb1dbe82 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:09.780416 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2ff3ebab-08e4-45dd-a459-da8bdb1dbe82 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:09.786911 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2ff3ebab-08e4-45dd-a459-da8bdb1dbe82 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:09.787371 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2ff3ebab-08e4-45dd-a459-da8bdb1dbe82 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:09.788172 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2ff3ebab-08e4-45dd-a459-da8bdb1dbe82 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:09.788873 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2ff3ebab-08e4-45dd-a459-da8bdb1dbe82 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:09.925476 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2ff3ebab-08e4-45dd-a459-da8bdb1dbe82 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:09.933440 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2ff3ebab-08e4-45dd-a459-da8bdb1dbe82 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.157217 Jan 17 21:24:09.934015 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 261/524] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:09 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:10.517975 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-fa687adb-fce7-46b4-a3f0-10435f487d8b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:10.518834 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-fa687adb-fce7-46b4-a3f0-10435f487d8b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:10.525885 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fa687adb-fce7-46b4-a3f0-10435f487d8b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:10.526349 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fa687adb-fce7-46b4-a3f0-10435f487d8b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:10.527148 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fa687adb-fce7-46b4-a3f0-10435f487d8b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:10.527591 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fa687adb-fce7-46b4-a3f0-10435f487d8b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:10.556104 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-fa687adb-fce7-46b4-a3f0-10435f487d8b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042337 Jan 17 21:24:10.556691 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 264/525] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:10 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:24:10.950635 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-507b4649-0678-4fba-9323-c6910703c672 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:10.951312 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-507b4649-0678-4fba-9323-c6910703c672 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:10.957678 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-507b4649-0678-4fba-9323-c6910703c672 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:10.958131 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-507b4649-0678-4fba-9323-c6910703c672 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:10.958947 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-507b4649-0678-4fba-9323-c6910703c672 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:10.959394 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-507b4649-0678-4fba-9323-c6910703c672 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:11.090158 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-507b4649-0678-4fba-9323-c6910703c672 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:11.097941 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-507b4649-0678-4fba-9323-c6910703c672 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.150887 Jan 17 21:24:11.098522 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 262/526] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:10 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:11.567418 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-eb1130d0-47d6-43e5-ab8f-12e098147daa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:11.568353 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-eb1130d0-47d6-43e5-ab8f-12e098147daa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:11.574879 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eb1130d0-47d6-43e5-ab8f-12e098147daa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:11.575424 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eb1130d0-47d6-43e5-ab8f-12e098147daa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:11.576122 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eb1130d0-47d6-43e5-ab8f-12e098147daa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:11.576591 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eb1130d0-47d6-43e5-ab8f-12e098147daa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:11.607663 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-eb1130d0-47d6-43e5-ab8f-12e098147daa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043887 Jan 17 21:24:11.608232 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 265/527] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:11 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:12.115346 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-393f73af-420e-4e95-a13b-f6018bf75de6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:12.116254 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-393f73af-420e-4e95-a13b-f6018bf75de6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:12.122929 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-393f73af-420e-4e95-a13b-f6018bf75de6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:12.123386 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-393f73af-420e-4e95-a13b-f6018bf75de6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:12.124422 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-393f73af-420e-4e95-a13b-f6018bf75de6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:12.124828 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-393f73af-420e-4e95-a13b-f6018bf75de6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:12.263036 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-393f73af-420e-4e95-a13b-f6018bf75de6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:12.275736 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-393f73af-420e-4e95-a13b-f6018bf75de6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.164196 Jan 17 21:24:12.276321 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 263/528] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:12 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:24:12.619833 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a0296822-b0d4-4a45-aaea-9faa10a86466 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:12.620817 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a0296822-b0d4-4a45-aaea-9faa10a86466 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:12.627206 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a0296822-b0d4-4a45-aaea-9faa10a86466 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:12.627671 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a0296822-b0d4-4a45-aaea-9faa10a86466 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:12.628491 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a0296822-b0d4-4a45-aaea-9faa10a86466 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:12.628939 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a0296822-b0d4-4a45-aaea-9faa10a86466 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:12.658866 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a0296822-b0d4-4a45-aaea-9faa10a86466 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043423 Jan 17 21:24:12.659430 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 266/529] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:12 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:13.292865 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-482f6447-e401-4bd4-afc6-3eb34c7fe545 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:13.293946 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-482f6447-e401-4bd4-afc6-3eb34c7fe545 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:13.300079 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-482f6447-e401-4bd4-afc6-3eb34c7fe545 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:13.300585 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-482f6447-e401-4bd4-afc6-3eb34c7fe545 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:13.301387 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-482f6447-e401-4bd4-afc6-3eb34c7fe545 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:13.301834 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-482f6447-e401-4bd4-afc6-3eb34c7fe545 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:13.443813 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-482f6447-e401-4bd4-afc6-3eb34c7fe545 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:13.451679 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-482f6447-e401-4bd4-afc6-3eb34c7fe545 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.162538 Jan 17 21:24:13.452259 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 264/530] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:13 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:13.675322 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e2521a7e-f99a-4fb9-84ab-d2e0c2b77eda tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:13.676240 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-e2521a7e-f99a-4fb9-84ab-d2e0c2b77eda tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:13.684082 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e2521a7e-f99a-4fb9-84ab-d2e0c2b77eda tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:13.684608 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e2521a7e-f99a-4fb9-84ab-d2e0c2b77eda tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:13.685424 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e2521a7e-f99a-4fb9-84ab-d2e0c2b77eda tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:13.685876 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e2521a7e-f99a-4fb9-84ab-d2e0c2b77eda tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:13.720358 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e2521a7e-f99a-4fb9-84ab-d2e0c2b77eda tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048693 Jan 17 21:24:13.720975 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 267/531] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:13 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:14.468393 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8a2bca5a-03af-4f3f-bf36-cfcf801b06ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:14.469113 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8a2bca5a-03af-4f3f-bf36-cfcf801b06ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:14.475390 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8a2bca5a-03af-4f3f-bf36-cfcf801b06ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:14.475853 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8a2bca5a-03af-4f3f-bf36-cfcf801b06ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:14.476678 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8a2bca5a-03af-4f3f-bf36-cfcf801b06ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:14.477126 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8a2bca5a-03af-4f3f-bf36-cfcf801b06ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:14.615562 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-8a2bca5a-03af-4f3f-bf36-cfcf801b06ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:14.623678 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8a2bca5a-03af-4f3f-bf36-cfcf801b06ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.158990 Jan 17 21:24:14.624243 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 265/532] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:14 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:14.732284 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d3fff6f3-5626-4e39-a98a-ef7fe2edd9d3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:14.733160 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d3fff6f3-5626-4e39-a98a-ef7fe2edd9d3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:14.739778 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3fff6f3-5626-4e39-a98a-ef7fe2edd9d3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:14.740239 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3fff6f3-5626-4e39-a98a-ef7fe2edd9d3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:14.741878 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3fff6f3-5626-4e39-a98a-ef7fe2edd9d3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:14.742334 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3fff6f3-5626-4e39-a98a-ef7fe2edd9d3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:14.772948 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d3fff6f3-5626-4e39-a98a-ef7fe2edd9d3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Jan 17 21:24:14.773504 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 268/533] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:14 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:15.642556 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8eb4c403-7ecb-4886-90be-4b28cc06f8ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:15.643097 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8eb4c403-7ecb-4886-90be-4b28cc06f8ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:15.650132 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8eb4c403-7ecb-4886-90be-4b28cc06f8ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:15.650576 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8eb4c403-7ecb-4886-90be-4b28cc06f8ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:15.651350 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8eb4c403-7ecb-4886-90be-4b28cc06f8ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:15.651785 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8eb4c403-7ecb-4886-90be-4b28cc06f8ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:15.782653 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-8eb4c403-7ecb-4886-90be-4b28cc06f8ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:15.784159 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9fe2437c-39ad-470e-aade-82f8a292542c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:15.785116 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-9fe2437c-39ad-470e-aade-82f8a292542c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:15.790390 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8eb4c403-7ecb-4886-90be-4b28cc06f8ce tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.151756 Jan 17 21:24:15.790956 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 266/534] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:15 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:15.791326 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9fe2437c-39ad-470e-aade-82f8a292542c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:15.791788 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9fe2437c-39ad-470e-aade-82f8a292542c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:15.792619 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9fe2437c-39ad-470e-aade-82f8a292542c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:15.793060 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9fe2437c-39ad-470e-aade-82f8a292542c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:15.823600 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-9fe2437c-39ad-470e-aade-82f8a292542c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043119 Jan 17 21:24:15.824166 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 269/535] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:15 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:24:16.806742 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fd11b775-ae24-4cc2-99b4-ac2d2988504d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:16.807289 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fd11b775-ae24-4cc2-99b4-ac2d2988504d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:16.813503 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd11b775-ae24-4cc2-99b4-ac2d2988504d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:16.813952 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd11b775-ae24-4cc2-99b4-ac2d2988504d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:16.814719 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd11b775-ae24-4cc2-99b4-ac2d2988504d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:16.815157 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd11b775-ae24-4cc2-99b4-ac2d2988504d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:16.835360 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c26bb1b8-f21a-4026-8056-910cbc97fab9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:16.836262 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c26bb1b8-f21a-4026-8056-910cbc97fab9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:16.842775 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c26bb1b8-f21a-4026-8056-910cbc97fab9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:16.843230 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c26bb1b8-f21a-4026-8056-910cbc97fab9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:16.844016 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c26bb1b8-f21a-4026-8056-910cbc97fab9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:16.844480 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c26bb1b8-f21a-4026-8056-910cbc97fab9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:16.874818 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c26bb1b8-f21a-4026-8056-910cbc97fab9 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043545 Jan 17 21:24:16.875389 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 270/536] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:16 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:24:16.944196 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-fd11b775-ae24-4cc2-99b4-ac2d2988504d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:16.951504 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fd11b775-ae24-4cc2-99b4-ac2d2988504d tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.148524 Jan 17 21:24:16.952072 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 267/537] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:16 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:17.886671 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5ff54f32-c287-4bb1-9dec-c61d790c6af0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:17.887638 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5ff54f32-c287-4bb1-9dec-c61d790c6af0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:17.893947 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5ff54f32-c287-4bb1-9dec-c61d790c6af0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:17.894406 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5ff54f32-c287-4bb1-9dec-c61d790c6af0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:17.895198 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5ff54f32-c287-4bb1-9dec-c61d790c6af0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:17.895642 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5ff54f32-c287-4bb1-9dec-c61d790c6af0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:17.925526 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5ff54f32-c287-4bb1-9dec-c61d790c6af0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042458 Jan 17 21:24:17.926093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 271/538] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:17 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:24:17.974358 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-39049895-c331-4fe1-8935-2889e1f9234f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:17.975521 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-39049895-c331-4fe1-8935-2889e1f9234f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:17.981985 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-39049895-c331-4fe1-8935-2889e1f9234f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:17.982450 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-39049895-c331-4fe1-8935-2889e1f9234f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:17.983254 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-39049895-c331-4fe1-8935-2889e1f9234f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:17.983699 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-39049895-c331-4fe1-8935-2889e1f9234f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:18.126670 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-39049895-c331-4fe1-8935-2889e1f9234f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:18.134886 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-39049895-c331-4fe1-8935-2889e1f9234f tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1508 microversion: 2.1 time: 0.167565 Jan 17 21:24:18.135518 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 268/539] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:17 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:18.307526 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-b65c9085-470a-494e-9a68-8a371b5bce28 req-cc58b18c-20b0-464e-9c30-ecf3e1ad03e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0057c90-b41a-4cd1-a9fa-01cb2da4fef6", "name": "network-vif-deleted", "tag": "97a2a727-ca87-4934-94e8-4e197d2e3622"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:24:18.309695 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:24:18.309695 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:24:18.319612 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-b65c9085-470a-494e-9a68-8a371b5bce28 req-cc58b18c-20b0-464e-9c30-ecf3e1ad03e2 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:18.320332 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-b65c9085-470a-494e-9a68-8a371b5bce28 req-cc58b18c-20b0-464e-9c30-ecf3e1ad03e2 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:18.333660 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-b65c9085-470a-494e-9a68-8a371b5bce28 req-cc58b18c-20b0-464e-9c30-ecf3e1ad03e2 service nova] Creating event network-vif-deleted:97a2a727-ca87-4934-94e8-4e197d2e3622 for instance e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 on hv-cinder-82489 Jan 17 21:24:18.340663 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-b65c9085-470a-494e-9a68-8a371b5bce28 req-cc58b18c-20b0-464e-9c30-ecf3e1ad03e2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037429 Jan 17 21:24:18.341802 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 272/540] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:18.937929 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-75bede2e-4995-4739-baf5-b5a29b2243a7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:18.938939 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-75bede2e-4995-4739-baf5-b5a29b2243a7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:18.944935 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-75bede2e-4995-4739-baf5-b5a29b2243a7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:18.945391 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-75bede2e-4995-4739-baf5-b5a29b2243a7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:18.946171 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-75bede2e-4995-4739-baf5-b5a29b2243a7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:18.946613 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-75bede2e-4995-4739-baf5-b5a29b2243a7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:18.976308 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-75bede2e-4995-4739-baf5-b5a29b2243a7 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042560 Jan 17 21:24:18.977173 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 269/541] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:18 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:24:19.152524 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ec228a99-31e8-4e89-9dce-4a97c8d290d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:19.153234 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ec228a99-31e8-4e89-9dce-4a97c8d290d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:19.160896 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec228a99-31e8-4e89-9dce-4a97c8d290d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:19.161213 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec228a99-31e8-4e89-9dce-4a97c8d290d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:19.162129 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec228a99-31e8-4e89-9dce-4a97c8d290d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:19.163213 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec228a99-31e8-4e89-9dce-4a97c8d290d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:19.194649 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec228a99-31e8-4e89-9dce-4a97c8d290d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:19.195105 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec228a99-31e8-4e89-9dce-4a97c8d290d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:19.195557 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.objects.instance [None req-ec228a99-31e8-4e89-9dce-4a97c8d290d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lazy-loading 'fault' on Instance uuid e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 {{(pid=116183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:24:19.247039 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ec228a99-31e8-4e89-9dce-4a97c8d290d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:19.253855 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ec228a99-31e8-4e89-9dce-4a97c8d290d6 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 200 len: 1312 microversion: 2.1 time: 0.105403 Jan 17 21:24:19.254420 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 273/542] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:19 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:19.987173 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c75e1a77-5d0d-4010-8207-987ca96fdd7c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:19.988080 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c75e1a77-5d0d-4010-8207-987ca96fdd7c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:19.994947 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c75e1a77-5d0d-4010-8207-987ca96fdd7c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:19.995400 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c75e1a77-5d0d-4010-8207-987ca96fdd7c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:19.996183 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c75e1a77-5d0d-4010-8207-987ca96fdd7c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:19.996650 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c75e1a77-5d0d-4010-8207-987ca96fdd7c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:20.024557 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c75e1a77-5d0d-4010-8207-987ca96fdd7c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041224 Jan 17 21:24:20.025104 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 270/543] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:24:19 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:24:20.183575 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1535040700", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452", "networks": [{"uuid": "90270886-8b72-4996-b451-52316e1bfe26"}]}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:24:20.234556 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.network.neutron [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] validate_networks() for [('90270886-8b72-4996-b451-52316e1bfe26', None, None, None, None, None)] {{(pid=116183) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:24:20.275766 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-dd0dda09-5a1d-4abf-8ac9-8b8b609d2f8e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:20.276612 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-dd0dda09-5a1d-4abf-8ac9-8b8b609d2f8e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: e0057c90-b41a-4cd1-a9fa-01cb2da4fef6] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:20.283076 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dd0dda09-5a1d-4abf-8ac9-8b8b609d2f8e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:20.283722 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dd0dda09-5a1d-4abf-8ac9-8b8b609d2f8e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:20.284740 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dd0dda09-5a1d-4abf-8ac9-8b8b609d2f8e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:20.285338 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dd0dda09-5a1d-4abf-8ac9-8b8b609d2f8e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:20.300362 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-dd0dda09-5a1d-4abf-8ac9-8b8b609d2f8e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] HTTP exception thrown: Instance e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 could not be found. Jan 17 21:24:20.301148 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-dd0dda09-5a1d-4abf-8ac9-8b8b609d2f8e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Returning 404 to user: Instance e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:24:20.302135 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-dd0dda09-5a1d-4abf-8ac9-8b8b609d2f8e tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6" status: 404 len: 111 microversion: 2.1 time: 0.031985 Jan 17 21:24:20.303180 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 271/544] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:20 2022] GET /compute/v2.1/servers/e0057c90-b41a-4cd1-a9fa-01cb2da4fef6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:24:20.311392 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-06c57281-7490-4b5c-b4bb-835aec1de318 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:20.311930 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-06c57281-7490-4b5c-b4bb-835aec1de318 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:20.319804 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-06c57281-7490-4b5c-b4bb-835aec1de318 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:20.320289 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-06c57281-7490-4b5c-b4bb-835aec1de318 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:20.328737 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-06c57281-7490-4b5c-b4bb-835aec1de318 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:20.334135 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-06c57281-7490-4b5c-b4bb-835aec1de318 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:20.361600 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-06c57281-7490-4b5c-b4bb-835aec1de318 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Going to try to terminate instance {{(pid=116182) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:24:20.464140 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-06c57281-7490-4b5c-b4bb-835aec1de318 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 204 len: 0 microversion: 2.1 time: 0.151939 Jan 17 21:24:20.465687 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 272/545] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:24:20 2022] DELETE /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:24:20.475282 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-94e159af-00b2-4ae0-b8de-d73b88d4bbb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:20.476170 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-94e159af-00b2-4ae0-b8de-d73b88d4bbb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:20.483077 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-94e159af-00b2-4ae0-b8de-d73b88d4bbb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:20.483714 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-94e159af-00b2-4ae0-b8de-d73b88d4bbb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:20.484633 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-94e159af-00b2-4ae0-b8de-d73b88d4bbb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:20.485139 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-94e159af-00b2-4ae0-b8de-d73b88d4bbb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:20.716249 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Flavor limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:24:20.716718 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Image limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:24:20.717184 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Flavor pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:24:20.717949 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Image pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:24:20.718530 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:24:20.728529 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:20.728852 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:20.729675 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:20.730118 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:20.741760 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-94e159af-00b2-4ae0-b8de-d73b88d4bbb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:20.747721 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Getting quotas for project 28496391913444ba9a1f04ca404c2c68. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:24:20.751804 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-94e159af-00b2-4ae0-b8de-d73b88d4bbb7 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.281973 Jan 17 21:24:20.752607 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 273/546] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:20 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:20.753630 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Getting quotas for user 5cfa3e62e8f64305a304058e9704ef23 and project 28496391913444ba9a1f04ca404c2c68. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:24:20.765056 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Going to run 1 instances... {{(pid=116183) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:24:20.767383 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:24:20.813550 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-530909b8-0f9a-45de-a487-f2d10e3000c0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635482 Jan 17 21:24:20.814201 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 274/547] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:24:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:24:20.824112 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-33cc1bed-dbac-4616-aaf0-2afb819726f3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:20.824774 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-33cc1bed-dbac-4616-aaf0-2afb819726f3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:20.877663 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-33cc1bed-dbac-4616-aaf0-2afb819726f3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:20.885279 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-33cc1bed-dbac-4616-aaf0-2afb819726f3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1218 microversion: 2.1 time: 0.064880 Jan 17 21:24:20.886061 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 274/548] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:20 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:24:21.769357 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7708f845-075f-4de1-a166-e31bf6adbfba tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:21.769962 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7708f845-075f-4de1-a166-e31bf6adbfba tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:21.777252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7708f845-075f-4de1-a166-e31bf6adbfba tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:21.777707 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7708f845-075f-4de1-a166-e31bf6adbfba tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:21.778585 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7708f845-075f-4de1-a166-e31bf6adbfba tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:21.778948 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7708f845-075f-4de1-a166-e31bf6adbfba tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:21.902828 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-91fa7287-99a8-47c9-aabb-64f8f0fc1405 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:21.903685 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-91fa7287-99a8-47c9-aabb-64f8f0fc1405 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:21.910036 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-91fa7287-99a8-47c9-aabb-64f8f0fc1405 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:21.910595 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-91fa7287-99a8-47c9-aabb-64f8f0fc1405 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:21.911660 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-91fa7287-99a8-47c9-aabb-64f8f0fc1405 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:21.912169 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-91fa7287-99a8-47c9-aabb-64f8f0fc1405 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:21.926577 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7708f845-075f-4de1-a166-e31bf6adbfba tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:21.935536 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7708f845-075f-4de1-a166-e31bf6adbfba tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.169567 Jan 17 21:24:21.936099 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 275/549] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:21 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:21.989820 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-91fa7287-99a8-47c9-aabb-64f8f0fc1405 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:22.001001 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-91fa7287-99a8-47c9-aabb-64f8f0fc1405 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1276 microversion: 2.1 time: 0.101621 Jan 17 21:24:22.001648 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 275/550] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:21 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:22.952090 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2d5abca8-8cae-4b58-aaf7-12f8d55e0f62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:22.952872 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2d5abca8-8cae-4b58-aaf7-12f8d55e0f62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:22.960663 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2d5abca8-8cae-4b58-aaf7-12f8d55e0f62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:22.961456 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2d5abca8-8cae-4b58-aaf7-12f8d55e0f62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:22.962800 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2d5abca8-8cae-4b58-aaf7-12f8d55e0f62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:22.963452 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2d5abca8-8cae-4b58-aaf7-12f8d55e0f62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:23.022282 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-82555eff-c81a-44f7-80eb-c8b573aff581 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:23.024264 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-82555eff-c81a-44f7-80eb-c8b573aff581 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:23.032766 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-82555eff-c81a-44f7-80eb-c8b573aff581 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:23.033848 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-82555eff-c81a-44f7-80eb-c8b573aff581 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:23.035471 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-82555eff-c81a-44f7-80eb-c8b573aff581 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:23.036173 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-82555eff-c81a-44f7-80eb-c8b573aff581 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:23.181293 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2d5abca8-8cae-4b58-aaf7-12f8d55e0f62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:23.190059 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2d5abca8-8cae-4b58-aaf7-12f8d55e0f62 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.241568 Jan 17 21:24:23.190785 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 276/551] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:22 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:23.229796 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-82555eff-c81a-44f7-80eb-c8b573aff581 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:23.241949 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-82555eff-c81a-44f7-80eb-c8b573aff581 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.227092 Jan 17 21:24:23.242532 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 276/552] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:23 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:23.253249 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-ee2a3959-73fb-4975-a700-a0414d2c6d8d req-42911336-70e5-43da-a34e-ce321b47262a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67bca008-58c3-469e-bda3-bbb2b89fa9be", "tag": "cedef62e-b83a-4220-b7ba-8ccc29087104"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:24:23.254772 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:24:23.254772 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:24:23.262285 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-ee2a3959-73fb-4975-a700-a0414d2c6d8d req-42911336-70e5-43da-a34e-ce321b47262a service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:23.262734 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-ee2a3959-73fb-4975-a700-a0414d2c6d8d req-42911336-70e5-43da-a34e-ce321b47262a service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:23.274756 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-ee2a3959-73fb-4975-a700-a0414d2c6d8d req-42911336-70e5-43da-a34e-ce321b47262a service nova] Creating event network-changed:cedef62e-b83a-4220-b7ba-8ccc29087104 for instance 67bca008-58c3-469e-bda3-bbb2b89fa9be on hv-cinder-82489 Jan 17 21:24:23.279648 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-ee2a3959-73fb-4975-a700-a0414d2c6d8d req-42911336-70e5-43da-a34e-ce321b47262a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030207 Jan 17 21:24:23.280241 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 277/553] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:23.849361 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b78bbfc0-8843-4fae-8c16-414c7a7b6ce0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:23.850495 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b78bbfc0-8843-4fae-8c16-414c7a7b6ce0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:23.856355 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b78bbfc0-8843-4fae-8c16-414c7a7b6ce0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:23.856849 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b78bbfc0-8843-4fae-8c16-414c7a7b6ce0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:23.857674 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b78bbfc0-8843-4fae-8c16-414c7a7b6ce0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:23.858353 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b78bbfc0-8843-4fae-8c16-414c7a7b6ce0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:23.941188 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-b78bbfc0-8843-4fae-8c16-414c7a7b6ce0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lazy-loading 'services' on Instance uuid 1a6ecab4-ad67-494d-8290-50992425966f {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:24:24.028132 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b78bbfc0-8843-4fae-8c16-414c7a7b6ce0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f/os-volume_attachments/192f4ecc-e316-40fc-b454-63cf15098e5c" status: 202 len: 0 microversion: 2.1 time: 0.182066 Jan 17 21:24:24.029594 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 277/554] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jan 17 21:24:23 2022] DELETE /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f/os-volume_attachments/192f4ecc-e316-40fc-b454-63cf15098e5c => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:24:24.208364 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6b264abf-6b65-475c-8a21-32ab515e5ad4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:24.209957 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6b264abf-6b65-475c-8a21-32ab515e5ad4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:24.216274 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6b264abf-6b65-475c-8a21-32ab515e5ad4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:24.216852 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6b264abf-6b65-475c-8a21-32ab515e5ad4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:24.217668 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6b264abf-6b65-475c-8a21-32ab515e5ad4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:24.218142 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6b264abf-6b65-475c-8a21-32ab515e5ad4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:24.260232 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c88115bb-008f-4935-b26f-47a345c1473c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:24.260938 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c88115bb-008f-4935-b26f-47a345c1473c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:24.273880 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c88115bb-008f-4935-b26f-47a345c1473c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:24.274888 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c88115bb-008f-4935-b26f-47a345c1473c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:24.276091 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c88115bb-008f-4935-b26f-47a345c1473c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:24.276814 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c88115bb-008f-4935-b26f-47a345c1473c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:24.390877 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6b264abf-6b65-475c-8a21-32ab515e5ad4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:24.398457 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6b264abf-6b65-475c-8a21-32ab515e5ad4 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.194793 Jan 17 21:24:24.399026 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 278/555] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:24 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:24.457701 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c88115bb-008f-4935-b26f-47a345c1473c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:24.465534 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c88115bb-008f-4935-b26f-47a345c1473c tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.210378 Jan 17 21:24:24.466215 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 278/556] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:24 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:25.415280 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1341d521-054e-4a61-8085-0cb201103cbd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:25.415874 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1341d521-054e-4a61-8085-0cb201103cbd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:25.422493 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1341d521-054e-4a61-8085-0cb201103cbd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:25.422971 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1341d521-054e-4a61-8085-0cb201103cbd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:25.423773 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1341d521-054e-4a61-8085-0cb201103cbd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:25.424220 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1341d521-054e-4a61-8085-0cb201103cbd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:25.482231 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-70f2136e-bb49-4eff-855c-e31392e1ee60 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:25.483462 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-70f2136e-bb49-4eff-855c-e31392e1ee60 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:25.492565 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-70f2136e-bb49-4eff-855c-e31392e1ee60 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:25.493036 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-70f2136e-bb49-4eff-855c-e31392e1ee60 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:25.493840 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-70f2136e-bb49-4eff-855c-e31392e1ee60 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:25.494281 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-70f2136e-bb49-4eff-855c-e31392e1ee60 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:25.629102 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1341d521-054e-4a61-8085-0cb201103cbd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:25.636658 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1341d521-054e-4a61-8085-0cb201103cbd tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.225427 Jan 17 21:24:25.637231 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 279/557] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:25 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:25.693501 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-70f2136e-bb49-4eff-855c-e31392e1ee60 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:25.707238 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-70f2136e-bb49-4eff-855c-e31392e1ee60 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.228679 Jan 17 21:24:25.707843 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 279/558] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:25 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:24:26.222075 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d13cc74f-cccd-499e-8b2a-97a664901423 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:26.222751 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d13cc74f-cccd-499e-8b2a-97a664901423 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:26.229340 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d13cc74f-cccd-499e-8b2a-97a664901423 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:26.229816 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d13cc74f-cccd-499e-8b2a-97a664901423 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:26.230593 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d13cc74f-cccd-499e-8b2a-97a664901423 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:26.231033 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d13cc74f-cccd-499e-8b2a-97a664901423 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:26.255786 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d13cc74f-cccd-499e-8b2a-97a664901423 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Going to try to terminate instance {{(pid=116183) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:24:26.346298 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d13cc74f-cccd-499e-8b2a-97a664901423 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 204 len: 0 microversion: 2.1 time: 0.127108 Jan 17 21:24:26.347937 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 280/559] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:24:26 2022] DELETE /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:24:26.357100 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-68af2ede-cbf6-4b99-b7e0-b18cd91d7dfb tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:26.357777 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-68af2ede-cbf6-4b99-b7e0-b18cd91d7dfb tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:26.365853 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-68af2ede-cbf6-4b99-b7e0-b18cd91d7dfb tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:26.366340 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-68af2ede-cbf6-4b99-b7e0-b18cd91d7dfb tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:26.367146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-68af2ede-cbf6-4b99-b7e0-b18cd91d7dfb tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:26.367597 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-68af2ede-cbf6-4b99-b7e0-b18cd91d7dfb tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:26.513124 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-68af2ede-cbf6-4b99-b7e0-b18cd91d7dfb tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:26.524416 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-68af2ede-cbf6-4b99-b7e0-b18cd91d7dfb tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1512 microversion: 2.1 time: 0.168057 Jan 17 21:24:26.524416 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 280/560] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:26 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:24:26.655252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-06f706d4-3552-4551-95a3-1f19b2518ab5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:26.655959 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-06f706d4-3552-4551-95a3-1f19b2518ab5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:26.663307 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-06f706d4-3552-4551-95a3-1f19b2518ab5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:26.663793 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-06f706d4-3552-4551-95a3-1f19b2518ab5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:26.664703 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-06f706d4-3552-4551-95a3-1f19b2518ab5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:26.666237 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-06f706d4-3552-4551-95a3-1f19b2518ab5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:26.725716 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-df2f3e26-7c2c-4f62-8008-51384ba96f85 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:26.726366 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-df2f3e26-7c2c-4f62-8008-51384ba96f85 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:26.733603 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-df2f3e26-7c2c-4f62-8008-51384ba96f85 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:26.734077 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-df2f3e26-7c2c-4f62-8008-51384ba96f85 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:26.734874 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-df2f3e26-7c2c-4f62-8008-51384ba96f85 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:26.735322 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-df2f3e26-7c2c-4f62-8008-51384ba96f85 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:26.828924 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-06f706d4-3552-4551-95a3-1f19b2518ab5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:26.838074 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-06f706d4-3552-4551-95a3-1f19b2518ab5 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.186785 Jan 17 21:24:26.838838 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 281/561] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:26 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:26.900305 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-df2f3e26-7c2c-4f62-8008-51384ba96f85 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:26.907678 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-df2f3e26-7c2c-4f62-8008-51384ba96f85 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.186444 Jan 17 21:24:26.908241 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 281/562] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:26 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:24:27.540170 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0c4e8d26-66bc-42ee-90ec-31df7980aa95 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:27.540567 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-0c4e8d26-66bc-42ee-90ec-31df7980aa95 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:27.547131 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0c4e8d26-66bc-42ee-90ec-31df7980aa95 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:27.547593 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0c4e8d26-66bc-42ee-90ec-31df7980aa95 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:27.548424 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0c4e8d26-66bc-42ee-90ec-31df7980aa95 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:27.548875 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0c4e8d26-66bc-42ee-90ec-31df7980aa95 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:27.705680 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-0c4e8d26-66bc-42ee-90ec-31df7980aa95 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:27.713740 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-0c4e8d26-66bc-42ee-90ec-31df7980aa95 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1512 microversion: 2.1 time: 0.178195 Jan 17 21:24:27.714948 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 282/563] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:27 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:27.855340 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-149d1c8e-8a18-4d56-a3c3-58eb8e33b9a0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:27.855947 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-149d1c8e-8a18-4d56-a3c3-58eb8e33b9a0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:27.862664 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-149d1c8e-8a18-4d56-a3c3-58eb8e33b9a0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:27.863122 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-149d1c8e-8a18-4d56-a3c3-58eb8e33b9a0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:27.863912 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-149d1c8e-8a18-4d56-a3c3-58eb8e33b9a0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:27.864354 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-149d1c8e-8a18-4d56-a3c3-58eb8e33b9a0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:27.924503 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-80d3e746-e281-4df5-bc86-d0ee902d71a4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:27.925120 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-80d3e746-e281-4df5-bc86-d0ee902d71a4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:27.932115 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-80d3e746-e281-4df5-bc86-d0ee902d71a4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:27.932605 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-80d3e746-e281-4df5-bc86-d0ee902d71a4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:27.933398 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-80d3e746-e281-4df5-bc86-d0ee902d71a4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:27.933831 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-80d3e746-e281-4df5-bc86-d0ee902d71a4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:28.099253 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-149d1c8e-8a18-4d56-a3c3-58eb8e33b9a0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:28.108562 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-149d1c8e-8a18-4d56-a3c3-58eb8e33b9a0 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.256598 Jan 17 21:24:28.109488 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 282/564] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:27 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:28.149069 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-80d3e746-e281-4df5-bc86-d0ee902d71a4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:28.156605 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-80d3e746-e281-4df5-bc86-d0ee902d71a4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.235694 Jan 17 21:24:28.157182 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 283/565] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:27 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:24:28.735580 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7d9c9c81-55bb-4813-ad06-596831655247 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:28.736733 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7d9c9c81-55bb-4813-ad06-596831655247 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:28.748806 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7d9c9c81-55bb-4813-ad06-596831655247 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:28.749521 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7d9c9c81-55bb-4813-ad06-596831655247 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:28.750933 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7d9c9c81-55bb-4813-ad06-596831655247 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:28.751727 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7d9c9c81-55bb-4813-ad06-596831655247 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:28.901365 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7d9c9c81-55bb-4813-ad06-596831655247 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:28.913105 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7d9c9c81-55bb-4813-ad06-596831655247 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1512 microversion: 2.1 time: 0.183940 Jan 17 21:24:28.913699 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 283/566] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:28 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:29.130365 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-855ffd1d-d5f9-4e9f-8728-2e770a0f7886 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:29.131517 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-855ffd1d-d5f9-4e9f-8728-2e770a0f7886 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:29.137676 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-855ffd1d-d5f9-4e9f-8728-2e770a0f7886 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:29.138133 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-855ffd1d-d5f9-4e9f-8728-2e770a0f7886 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:29.138980 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-855ffd1d-d5f9-4e9f-8728-2e770a0f7886 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:29.139430 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-855ffd1d-d5f9-4e9f-8728-2e770a0f7886 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:29.173929 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7e660d70-2994-4b1a-9dce-ff728f0245f0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:29.174538 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7e660d70-2994-4b1a-9dce-ff728f0245f0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:29.180609 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7e660d70-2994-4b1a-9dce-ff728f0245f0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:29.181263 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7e660d70-2994-4b1a-9dce-ff728f0245f0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:29.182110 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7e660d70-2994-4b1a-9dce-ff728f0245f0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:29.182498 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7e660d70-2994-4b1a-9dce-ff728f0245f0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:29.304394 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-855ffd1d-d5f9-4e9f-8728-2e770a0f7886 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:29.312462 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-855ffd1d-d5f9-4e9f-8728-2e770a0f7886 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1520 microversion: 2.1 time: 0.186342 Jan 17 21:24:29.313007 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 284/567] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:29 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:29.371490 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7e660d70-2994-4b1a-9dce-ff728f0245f0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:29.378179 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7e660d70-2994-4b1a-9dce-ff728f0245f0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.207895 Jan 17 21:24:29.378764 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 284/568] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:29 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:24:29.934242 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-250352b0-c55a-4c82-90d2-ac203ce0a76e tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:29.935424 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-250352b0-c55a-4c82-90d2-ac203ce0a76e tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:29.946667 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-250352b0-c55a-4c82-90d2-ac203ce0a76e tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:29.947485 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-250352b0-c55a-4c82-90d2-ac203ce0a76e tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:29.949264 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-250352b0-c55a-4c82-90d2-ac203ce0a76e tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:29.950330 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-250352b0-c55a-4c82-90d2-ac203ce0a76e tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:30.119231 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-992c4736-8417-4a93-8d8c-d40275d272ef req-4103bcdd-c6f4-4782-bdb3-ebbd95ef2636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5818e4-0026-4597-9ef3-d539c2cdee97", "name": "network-vif-deleted", "tag": "138d0a50-2135-4dee-95fa-28ecdc541d3d"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:24:30.122315 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:24:30.122315 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:24:30.135310 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-992c4736-8417-4a93-8d8c-d40275d272ef req-4103bcdd-c6f4-4782-bdb3-ebbd95ef2636 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:30.136159 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-992c4736-8417-4a93-8d8c-d40275d272ef req-4103bcdd-c6f4-4782-bdb3-ebbd95ef2636 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:30.171663 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-992c4736-8417-4a93-8d8c-d40275d272ef req-4103bcdd-c6f4-4782-bdb3-ebbd95ef2636 service nova] Creating event network-vif-deleted:138d0a50-2135-4dee-95fa-28ecdc541d3d for instance 8a5818e4-0026-4597-9ef3-d539c2cdee97 on hv-cinder-82489 Jan 17 21:24:30.178740 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-992c4736-8417-4a93-8d8c-d40275d272ef req-4103bcdd-c6f4-4782-bdb3-ebbd95ef2636 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064368 Jan 17 21:24:30.180534 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 285/569] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:30.331925 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-41ad5b04-7add-4e5d-a52c-617a68500026 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:30.332665 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-41ad5b04-7add-4e5d-a52c-617a68500026 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:30.340360 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41ad5b04-7add-4e5d-a52c-617a68500026 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:30.341141 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41ad5b04-7add-4e5d-a52c-617a68500026 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:30.341975 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41ad5b04-7add-4e5d-a52c-617a68500026 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:30.342503 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41ad5b04-7add-4e5d-a52c-617a68500026 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:30.402147 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41ad5b04-7add-4e5d-a52c-617a68500026 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:30.402842 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41ad5b04-7add-4e5d-a52c-617a68500026 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:30.403408 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-41ad5b04-7add-4e5d-a52c-617a68500026 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lazy-loading 'fault' on Instance uuid 8a5818e4-0026-4597-9ef3-d539c2cdee97 {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:24:30.469641 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-41ad5b04-7add-4e5d-a52c-617a68500026 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62d1680b47584ecba63c0ff2ee7667c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090730c5b4bb4a7195d893aa312dcfe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:30.479094 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-41ad5b04-7add-4e5d-a52c-617a68500026 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 200 len: 1311 microversion: 2.1 time: 0.151989 Jan 17 21:24:30.480908 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 286/570] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:30 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 1311 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:30.482435 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-250352b0-c55a-4c82-90d2-ac203ce0a76e tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:30.486464 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7588e02c-866e-4460-b946-e056fd722ac2 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:30.487069 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7588e02c-866e-4460-b946-e056fd722ac2 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:30.492013 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-250352b0-c55a-4c82-90d2-ac203ce0a76e tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1512 microversion: 2.1 time: 0.564726 Jan 17 21:24:30.493045 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 285/571] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:29 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1512 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:24:30.494701 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7588e02c-866e-4460-b946-e056fd722ac2 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:30.495162 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7588e02c-866e-4460-b946-e056fd722ac2 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:30.496146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7588e02c-866e-4460-b946-e056fd722ac2 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:30.496669 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7588e02c-866e-4460-b946-e056fd722ac2 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:30.695679 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7588e02c-866e-4460-b946-e056fd722ac2 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:30.705683 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7588e02c-866e-4460-b946-e056fd722ac2 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.223463 Jan 17 21:24:30.706935 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 287/572] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:30 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:30.802057 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-9e93f82e-7299-4f54-9071-13a1bc8e79ee req-09e8b7c1-70c0-44a9-8984-e7c50ad4eb1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6ecab4-ad67-494d-8290-50992425966f", "name": "network-vif-deleted", "tag": "0f32a145-2070-4f51-b7d2-0671cb8e4109"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:24:30.804211 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:24:30.804211 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:24:30.812853 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-9e93f82e-7299-4f54-9071-13a1bc8e79ee req-09e8b7c1-70c0-44a9-8984-e7c50ad4eb1a service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:30.813859 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-9e93f82e-7299-4f54-9071-13a1bc8e79ee req-09e8b7c1-70c0-44a9-8984-e7c50ad4eb1a service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:30.840760 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-9e93f82e-7299-4f54-9071-13a1bc8e79ee req-09e8b7c1-70c0-44a9-8984-e7c50ad4eb1a service nova] Creating event network-vif-deleted:0f32a145-2070-4f51-b7d2-0671cb8e4109 for instance 1a6ecab4-ad67-494d-8290-50992425966f on hv-cinder-82489 Jan 17 21:24:30.845859 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-9e93f82e-7299-4f54-9071-13a1bc8e79ee req-09e8b7c1-70c0-44a9-8984-e7c50ad4eb1a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047233 Jan 17 21:24:30.850026 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 286/573] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:31.497298 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b43d1d67-97b1-4da9-b34f-ec30bd175e95 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:31.497963 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b43d1d67-97b1-4da9-b34f-ec30bd175e95 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] [instance: 8a5818e4-0026-4597-9ef3-d539c2cdee97] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:31.504814 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b43d1d67-97b1-4da9-b34f-ec30bd175e95 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:31.505307 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b43d1d67-97b1-4da9-b34f-ec30bd175e95 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:31.506259 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b43d1d67-97b1-4da9-b34f-ec30bd175e95 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:31.506766 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b43d1d67-97b1-4da9-b34f-ec30bd175e95 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:31.516119 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-332dd046-9f73-449e-abe6-1607cdd2aeec tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:31.517420 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-332dd046-9f73-449e-abe6-1607cdd2aeec tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:31.523183 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-b43d1d67-97b1-4da9-b34f-ec30bd175e95 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] HTTP exception thrown: Instance 8a5818e4-0026-4597-9ef3-d539c2cdee97 could not be found. Jan 17 21:24:31.523792 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b43d1d67-97b1-4da9-b34f-ec30bd175e95 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] Returning 404 to user: Instance 8a5818e4-0026-4597-9ef3-d539c2cdee97 could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:24:31.524681 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b43d1d67-97b1-4da9-b34f-ec30bd175e95 tempest-ServerRescueNegativeTestJSON-749603551 tempest-ServerRescueNegativeTestJSON-749603551-project] 10.222.0.64 "GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97" status: 404 len: 111 microversion: 2.1 time: 0.031018 Jan 17 21:24:31.525515 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 288/574] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:31 2022] GET /compute/v2.1/servers/8a5818e4-0026-4597-9ef3-d539c2cdee97 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:24:31.526786 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-332dd046-9f73-449e-abe6-1607cdd2aeec tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:31.527588 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-332dd046-9f73-449e-abe6-1607cdd2aeec tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:31.529625 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-332dd046-9f73-449e-abe6-1607cdd2aeec tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:31.530082 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-332dd046-9f73-449e-abe6-1607cdd2aeec tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:31.574449 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-332dd046-9f73-449e-abe6-1607cdd2aeec tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:31.575208 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-332dd046-9f73-449e-abe6-1607cdd2aeec tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:31.575760 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.objects.instance [None req-332dd046-9f73-449e-abe6-1607cdd2aeec tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lazy-loading 'fault' on Instance uuid 1a6ecab4-ad67-494d-8290-50992425966f {{(pid=116183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:24:31.622209 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-332dd046-9f73-449e-abe6-1607cdd2aeec tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:31.629707 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-332dd046-9f73-449e-abe6-1607cdd2aeec tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 200 len: 1308 microversion: 2.1 time: 0.122503 Jan 17 21:24:31.630246 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 287/575] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:31 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 1308 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:31.721934 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-489456d0-d9d5-4063-88d5-556bea2ac02b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:31.722541 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-489456d0-d9d5-4063-88d5-556bea2ac02b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:31.729765 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-489456d0-d9d5-4063-88d5-556bea2ac02b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:31.730497 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-489456d0-d9d5-4063-88d5-556bea2ac02b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:31.731523 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-489456d0-d9d5-4063-88d5-556bea2ac02b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:31.732139 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-489456d0-d9d5-4063-88d5-556bea2ac02b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:31.891610 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-489456d0-d9d5-4063-88d5-556bea2ac02b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:31.900784 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-489456d0-d9d5-4063-88d5-556bea2ac02b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.182423 Jan 17 21:24:31.901864 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 289/576] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:31 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:32.648156 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3c5e3e61-06ab-4acb-a19c-e2b18afe734b tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:32.649291 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3c5e3e61-06ab-4acb-a19c-e2b18afe734b tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: 1a6ecab4-ad67-494d-8290-50992425966f] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:32.656133 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c5e3e61-06ab-4acb-a19c-e2b18afe734b tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:32.656707 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c5e3e61-06ab-4acb-a19c-e2b18afe734b tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:32.657764 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c5e3e61-06ab-4acb-a19c-e2b18afe734b tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:32.658232 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c5e3e61-06ab-4acb-a19c-e2b18afe734b tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:32.674995 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-3c5e3e61-06ab-4acb-a19c-e2b18afe734b tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] HTTP exception thrown: Instance 1a6ecab4-ad67-494d-8290-50992425966f could not be found. Jan 17 21:24:32.675580 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3c5e3e61-06ab-4acb-a19c-e2b18afe734b tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Returning 404 to user: Instance 1a6ecab4-ad67-494d-8290-50992425966f could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:24:32.676427 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3c5e3e61-06ab-4acb-a19c-e2b18afe734b tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f" status: 404 len: 111 microversion: 2.1 time: 0.032434 Jan 17 21:24:32.676970 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 288/577] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:32 2022] GET /compute/v2.1/servers/1a6ecab4-ad67-494d-8290-50992425966f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:24:32.919167 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-12b6c437-b455-4585-b0cb-281a9f31e79f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:32.919910 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-12b6c437-b455-4585-b0cb-281a9f31e79f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:32.931045 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-12b6c437-b455-4585-b0cb-281a9f31e79f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:32.931611 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-12b6c437-b455-4585-b0cb-281a9f31e79f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:32.932577 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-12b6c437-b455-4585-b0cb-281a9f31e79f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:32.933220 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-12b6c437-b455-4585-b0cb-281a9f31e79f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:33.131730 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-12b6c437-b455-4585-b0cb-281a9f31e79f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:33.139786 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-12b6c437-b455-4585-b0cb-281a9f31e79f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.224451 Jan 17 21:24:33.140353 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 290/578] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:32 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:34.156755 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-62f09028-58d7-4ac3-b27b-abbe1ae77c9e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:34.157475 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-62f09028-58d7-4ac3-b27b-abbe1ae77c9e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:34.164167 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-62f09028-58d7-4ac3-b27b-abbe1ae77c9e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:34.164727 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-62f09028-58d7-4ac3-b27b-abbe1ae77c9e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:34.165599 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-62f09028-58d7-4ac3-b27b-abbe1ae77c9e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:34.166120 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-62f09028-58d7-4ac3-b27b-abbe1ae77c9e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:34.296730 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-62f09028-58d7-4ac3-b27b-abbe1ae77c9e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:34.305248 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-62f09028-58d7-4ac3-b27b-abbe1ae77c9e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.151989 Jan 17 21:24:34.305824 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 289/579] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:34 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:34.531159 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-65093831-94c8-4603-910f-27dee211ffe4 req-2d2e4878-a6b4-43de-bc39-24affd261346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67bca008-58c3-469e-bda3-bbb2b89fa9be", "name": "network-vif-plugged", "status": "completed", "tag": "cedef62e-b83a-4220-b7ba-8ccc29087104"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:24:34.532910 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:24:34.532910 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:24:34.541784 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-65093831-94c8-4603-910f-27dee211ffe4 req-2d2e4878-a6b4-43de-bc39-24affd261346 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:34.542244 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-65093831-94c8-4603-910f-27dee211ffe4 req-2d2e4878-a6b4-43de-bc39-24affd261346 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:34.562197 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-65093831-94c8-4603-910f-27dee211ffe4 req-2d2e4878-a6b4-43de-bc39-24affd261346 service nova] Creating event network-vif-plugged:cedef62e-b83a-4220-b7ba-8ccc29087104 for instance 67bca008-58c3-469e-bda3-bbb2b89fa9be on hv-cinder-82489 Jan 17 21:24:34.567626 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-65093831-94c8-4603-910f-27dee211ffe4 req-2d2e4878-a6b4-43de-bc39-24affd261346 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040378 Jan 17 21:24:34.568594 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 291/580] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:24:35.323388 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-742a8a6b-02b1-4c24-850b-bbedc7b8d5e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:35.323920 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-742a8a6b-02b1-4c24-850b-bbedc7b8d5e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:35.330384 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-742a8a6b-02b1-4c24-850b-bbedc7b8d5e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:35.330850 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-742a8a6b-02b1-4c24-850b-bbedc7b8d5e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:35.331652 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-742a8a6b-02b1-4c24-850b-bbedc7b8d5e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:35.332096 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-742a8a6b-02b1-4c24-850b-bbedc7b8d5e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:35.501139 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-742a8a6b-02b1-4c24-850b-bbedc7b8d5e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:35.509251 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-742a8a6b-02b1-4c24-850b-bbedc7b8d5e6 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.189715 Jan 17 21:24:35.510245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 290/581] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:35 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:36.528083 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c0eb5337-1c08-48ac-9ed5-13478a3bd7bc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:36.528839 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c0eb5337-1c08-48ac-9ed5-13478a3bd7bc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:36.534976 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c0eb5337-1c08-48ac-9ed5-13478a3bd7bc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:36.535428 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c0eb5337-1c08-48ac-9ed5-13478a3bd7bc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:36.536445 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c0eb5337-1c08-48ac-9ed5-13478a3bd7bc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:36.537517 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c0eb5337-1c08-48ac-9ed5-13478a3bd7bc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:36.704774 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c0eb5337-1c08-48ac-9ed5-13478a3bd7bc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:36.712735 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c0eb5337-1c08-48ac-9ed5-13478a3bd7bc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.189031 Jan 17 21:24:36.713593 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 292/582] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:36 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:37.730884 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1dd6e2df-9c0b-4f75-95ca-2048f21fc219 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:37.731428 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1dd6e2df-9c0b-4f75-95ca-2048f21fc219 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:37.738395 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1dd6e2df-9c0b-4f75-95ca-2048f21fc219 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:37.739170 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1dd6e2df-9c0b-4f75-95ca-2048f21fc219 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:37.740599 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1dd6e2df-9c0b-4f75-95ca-2048f21fc219 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:37.741053 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1dd6e2df-9c0b-4f75-95ca-2048f21fc219 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:37.955986 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1dd6e2df-9c0b-4f75-95ca-2048f21fc219 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:37.967463 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1dd6e2df-9c0b-4f75-95ca-2048f21fc219 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.240305 Jan 17 21:24:37.969005 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 291/583] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:37 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:38.987016 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-996b4eca-ea42-4c92-921f-c80777c0c8dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:38.988278 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-996b4eca-ea42-4c92-921f-c80777c0c8dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:38.997857 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-996b4eca-ea42-4c92-921f-c80777c0c8dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:38.998696 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-996b4eca-ea42-4c92-921f-c80777c0c8dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:38.999713 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-996b4eca-ea42-4c92-921f-c80777c0c8dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:39.000710 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-996b4eca-ea42-4c92-921f-c80777c0c8dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:39.340133 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-996b4eca-ea42-4c92-921f-c80777c0c8dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:39.350879 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-996b4eca-ea42-4c92-921f-c80777c0c8dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.367828 Jan 17 21:24:39.351965 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 293/584] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:38 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:40.367488 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c0d8c580-154d-433e-83f0-622bb9dde943 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:40.368102 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c0d8c580-154d-433e-83f0-622bb9dde943 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:40.374685 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c0d8c580-154d-433e-83f0-622bb9dde943 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:40.375494 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c0d8c580-154d-433e-83f0-622bb9dde943 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:40.376529 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c0d8c580-154d-433e-83f0-622bb9dde943 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:40.377142 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c0d8c580-154d-433e-83f0-622bb9dde943 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:40.663600 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-c0d8c580-154d-433e-83f0-622bb9dde943 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:40.672517 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c0d8c580-154d-433e-83f0-622bb9dde943 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.309163 Jan 17 21:24:40.676926 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 292/585] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:40 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:41.245143 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-cb3886f1-03a4-49dd-8cca-ae49ccbcce99 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'create', calling method: .version_select at 0x7f8976109430>, body: {"keypair": {"name": "tempest-keypair-1772654283"}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:24:41.260314 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-cb3886f1-03a4-49dd-8cca-ae49ccbcce99 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Getting quotas for project 3391c884182f46fc99248b8f0ba1822f. Resources: {'key_pairs'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:24:41.264965 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-cb3886f1-03a4-49dd-8cca-ae49ccbcce99 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Getting quotas for user e157700e929e4e569557016122cf47cf and project 3391c884182f46fc99248b8f0ba1822f. Resources: {'key_pairs'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:24:41.542806 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-cb3886f1-03a4-49dd-8cca-ae49ccbcce99 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Getting quotas for project 3391c884182f46fc99248b8f0ba1822f. Resources: {'key_pairs'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:24:41.547371 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-cb3886f1-03a4-49dd-8cca-ae49ccbcce99 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Getting quotas for user e157700e929e4e569557016122cf47cf and project 3391c884182f46fc99248b8f0ba1822f. Resources: {'key_pairs'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:24:41.562514 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-cb3886f1-03a4-49dd-8cca-ae49ccbcce99 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.457329 Jan 17 21:24:41.563363 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 294/586] 10.222.0.64 () {62 vars in 1198 bytes} [Mon Jan 17 21:24:41 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 459 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 17 21:24:41.690809 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b6c5246d-c78d-4228-bf8b-5b6c480d86d4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:41.691664 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b6c5246d-c78d-4228-bf8b-5b6c480d86d4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:41.700258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b6c5246d-c78d-4228-bf8b-5b6c480d86d4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:41.700752 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b6c5246d-c78d-4228-bf8b-5b6c480d86d4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:41.701788 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b6c5246d-c78d-4228-bf8b-5b6c480d86d4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:41.702220 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b6c5246d-c78d-4228-bf8b-5b6c480d86d4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:41.909670 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b6c5246d-c78d-4228-bf8b-5b6c480d86d4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:41.921414 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b6c5246d-c78d-4228-bf8b-5b6c480d86d4 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.235749 Jan 17 21:24:41.922526 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 293/587] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:41 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:42.939528 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ac6a6ecd-0c50-498a-a2a0-27c9d0b9fcaa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:42.940118 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ac6a6ecd-0c50-498a-a2a0-27c9d0b9fcaa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:42.947245 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac6a6ecd-0c50-498a-a2a0-27c9d0b9fcaa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:42.947708 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac6a6ecd-0c50-498a-a2a0-27c9d0b9fcaa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:42.948561 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac6a6ecd-0c50-498a-a2a0-27c9d0b9fcaa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:42.949010 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac6a6ecd-0c50-498a-a2a0-27c9d0b9fcaa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:43.134760 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ac6a6ecd-0c50-498a-a2a0-27c9d0b9fcaa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:43.138101 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1520242923", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0ec84dc-cf63-4d34-bc61-575dee41c738"}], "security_groups": [{"name": "tempest-securitygroup--662096282"}], "key_name": "tempest-keypair-1772654283", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:24:43.142545 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ac6a6ecd-0c50-498a-a2a0-27c9d0b9fcaa tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1318 microversion: 2.1 time: 0.207294 Jan 17 21:24:43.143245 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 295/588] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:42 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:43.256809 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.network.neutron [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] validate_networks() for [('c0ec84dc-cf63-4d34-bc61-575dee41c738', None, None, None, None, None)] {{(pid=116183) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:24:43.946348 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Flavor limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:24:43.948718 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Image limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:24:43.949665 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Flavor pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:24:43.950429 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Image pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:24:43.951082 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:24:43.970939 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:43.971770 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:43.973248 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:43.974542 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:43.998649 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Getting quotas for project 3391c884182f46fc99248b8f0ba1822f. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:24:44.004791 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Getting quotas for user e157700e929e4e569557016122cf47cf and project 3391c884182f46fc99248b8f0ba1822f. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:24:44.017963 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Going to run 1 instances... {{(pid=116183) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:24:44.021219 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:24:44.084750 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-cac2bdae-3341-4ddf-8131-5d43ae363a66 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.950526 Jan 17 21:24:44.086486 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 294/589] 10.222.0.64 () {62 vars in 1187 bytes} [Mon Jan 17 21:24:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jan 17 21:24:44.106261 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fb0f4b29-5340-4dcb-9efb-121bd4342ca0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:44.118160 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fb0f4b29-5340-4dcb-9efb-121bd4342ca0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:44.163165 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-81c2ecfe-3b9a-4019-9de2-539042c48831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:44.169648 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-81c2ecfe-3b9a-4019-9de2-539042c48831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:44.195977 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-81c2ecfe-3b9a-4019-9de2-539042c48831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:44.196350 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-81c2ecfe-3b9a-4019-9de2-539042c48831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:44.197193 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-81c2ecfe-3b9a-4019-9de2-539042c48831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:44.197616 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-81c2ecfe-3b9a-4019-9de2-539042c48831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:44.227413 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-fb0f4b29-5340-4dcb-9efb-121bd4342ca0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:44.236037 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-fb0f4b29-5340-4dcb-9efb-121bd4342ca0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:44.237629 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-fb0f4b29-5340-4dcb-9efb-121bd4342ca0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:44.238751 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fb0f4b29-5340-4dcb-9efb-121bd4342ca0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1282 microversion: 2.20 time: 0.142311 Jan 17 21:24:44.239331 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 296/590] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:24:44 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1282 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:24:44.420603 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-81c2ecfe-3b9a-4019-9de2-539042c48831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:44.428252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-81c2ecfe-3b9a-4019-9de2-539042c48831 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1509 microversion: 2.1 time: 0.271622 Jan 17 21:24:44.439957 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 295/591] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:44 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1509 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:45.257984 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3ad48fef-d224-4941-b018-1743a184fe35 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:45.258613 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-3ad48fef-d224-4941-b018-1743a184fe35 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:45.267628 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ad48fef-d224-4941-b018-1743a184fe35 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:45.268295 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ad48fef-d224-4941-b018-1743a184fe35 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:45.269148 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ad48fef-d224-4941-b018-1743a184fe35 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:45.269596 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ad48fef-d224-4941-b018-1743a184fe35 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:45.336522 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-3ad48fef-d224-4941-b018-1743a184fe35 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:45.345864 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-3ad48fef-d224-4941-b018-1743a184fe35 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:45.347387 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-3ad48fef-d224-4941-b018-1743a184fe35 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:45.348582 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3ad48fef-d224-4941-b018-1743a184fe35 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1334 microversion: 2.20 time: 0.094430 Jan 17 21:24:45.350308 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 297/592] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:24:45 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:24:46.374154 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6c97e4b7-a397-46d5-832e-eba6a53002ae tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:46.374851 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6c97e4b7-a397-46d5-832e-eba6a53002ae tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:46.383135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6c97e4b7-a397-46d5-832e-eba6a53002ae tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:46.383939 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6c97e4b7-a397-46d5-832e-eba6a53002ae tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:46.384774 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6c97e4b7-a397-46d5-832e-eba6a53002ae tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:46.385211 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6c97e4b7-a397-46d5-832e-eba6a53002ae tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:46.457499 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6c97e4b7-a397-46d5-832e-eba6a53002ae tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:46.469813 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6c97e4b7-a397-46d5-832e-eba6a53002ae tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:46.471711 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6c97e4b7-a397-46d5-832e-eba6a53002ae tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:46.472833 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6c97e4b7-a397-46d5-832e-eba6a53002ae tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1352 microversion: 2.20 time: 0.102380 Jan 17 21:24:46.480692 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 296/593] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:24:46 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:24:47.495898 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3f14d87c-f4e7-4c9b-b26c-472cff1b1ed5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:47.496520 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-3f14d87c-f4e7-4c9b-b26c-472cff1b1ed5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:47.503467 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3f14d87c-f4e7-4c9b-b26c-472cff1b1ed5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:47.503928 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3f14d87c-f4e7-4c9b-b26c-472cff1b1ed5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:47.505330 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3f14d87c-f4e7-4c9b-b26c-472cff1b1ed5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:47.505722 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3f14d87c-f4e7-4c9b-b26c-472cff1b1ed5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:47.570168 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-3f14d87c-f4e7-4c9b-b26c-472cff1b1ed5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:47.579236 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-3f14d87c-f4e7-4c9b-b26c-472cff1b1ed5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:47.580755 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-3f14d87c-f4e7-4c9b-b26c-472cff1b1ed5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:47.581887 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3f14d87c-f4e7-4c9b-b26c-472cff1b1ed5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1340 microversion: 2.20 time: 0.089899 Jan 17 21:24:47.582473 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 298/594] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:24:47 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1340 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:24:48.603806 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d76c09ff-138f-4b73-a38c-4de269d569a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:48.604715 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d76c09ff-138f-4b73-a38c-4de269d569a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:48.611434 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d76c09ff-138f-4b73-a38c-4de269d569a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:48.611888 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d76c09ff-138f-4b73-a38c-4de269d569a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:48.612713 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d76c09ff-138f-4b73-a38c-4de269d569a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:48.613159 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d76c09ff-138f-4b73-a38c-4de269d569a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:48.674129 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-d76c09ff-138f-4b73-a38c-4de269d569a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:48.683014 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-d76c09ff-138f-4b73-a38c-4de269d569a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:48.684535 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-d76c09ff-138f-4b73-a38c-4de269d569a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:48.685621 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d76c09ff-138f-4b73-a38c-4de269d569a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1340 microversion: 2.20 time: 0.087554 Jan 17 21:24:48.686180 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 297/595] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:24:48 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1340 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:24:49.705393 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-baf4b657-a664-4b48-802b-8f9c4eab5f60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:49.705976 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-baf4b657-a664-4b48-802b-8f9c4eab5f60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:49.713095 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-baf4b657-a664-4b48-802b-8f9c4eab5f60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:49.713542 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-baf4b657-a664-4b48-802b-8f9c4eab5f60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:49.714316 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-baf4b657-a664-4b48-802b-8f9c4eab5f60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:49.714750 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-baf4b657-a664-4b48-802b-8f9c4eab5f60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:49.777840 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-baf4b657-a664-4b48-802b-8f9c4eab5f60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:49.785692 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-baf4b657-a664-4b48-802b-8f9c4eab5f60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:49.787174 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-baf4b657-a664-4b48-802b-8f9c4eab5f60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:49.788337 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-baf4b657-a664-4b48-802b-8f9c4eab5f60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1340 microversion: 2.20 time: 0.086598 Jan 17 21:24:49.789428 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 299/596] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:24:49 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1340 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:24:50.806244 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4a881e90-eac5-422d-b152-14248a858307 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:50.806955 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4a881e90-eac5-422d-b152-14248a858307 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:50.813702 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a881e90-eac5-422d-b152-14248a858307 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:50.814158 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a881e90-eac5-422d-b152-14248a858307 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:50.814945 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a881e90-eac5-422d-b152-14248a858307 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:50.815380 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a881e90-eac5-422d-b152-14248a858307 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:50.954577 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4a881e90-eac5-422d-b152-14248a858307 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:50.963413 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4a881e90-eac5-422d-b152-14248a858307 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:50.964925 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4a881e90-eac5-422d-b152-14248a858307 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:50.966053 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4a881e90-eac5-422d-b152-14248a858307 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1407 microversion: 2.20 time: 0.163586 Jan 17 21:24:50.966601 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 298/597] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:24:50 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:24:51.768222 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-a2b34107-7698-462d-8e4b-52bbeaf8c337 req-fb046866-9fdb-4a0e-86a9-e25d4901d439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5edb3c99-d30d-4a2c-8b50-5083b7ea9d96", "tag": "dde4fe76-f1d0-4978-a642-2a35761fdf74"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:24:51.769910 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:24:51.769910 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:24:51.777103 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-a2b34107-7698-462d-8e4b-52bbeaf8c337 req-fb046866-9fdb-4a0e-86a9-e25d4901d439 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:51.777816 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-a2b34107-7698-462d-8e4b-52bbeaf8c337 req-fb046866-9fdb-4a0e-86a9-e25d4901d439 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:51.790763 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-a2b34107-7698-462d-8e4b-52bbeaf8c337 req-fb046866-9fdb-4a0e-86a9-e25d4901d439 service nova] Creating event network-changed:dde4fe76-f1d0-4978-a642-2a35761fdf74 for instance 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 on hv-cinder-82489 Jan 17 21:24:51.802811 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-a2b34107-7698-462d-8e4b-52bbeaf8c337 req-fb046866-9fdb-4a0e-86a9-e25d4901d439 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037929 Jan 17 21:24:51.803738 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 300/598] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:51.983241 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3c9b806c-ebd5-47c9-90c8-00ecc6f5756a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:51.983866 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3c9b806c-ebd5-47c9-90c8-00ecc6f5756a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:51.990953 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c9b806c-ebd5-47c9-90c8-00ecc6f5756a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:51.991408 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c9b806c-ebd5-47c9-90c8-00ecc6f5756a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:51.992205 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c9b806c-ebd5-47c9-90c8-00ecc6f5756a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:51.992681 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c9b806c-ebd5-47c9-90c8-00ecc6f5756a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:52.125397 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3c9b806c-ebd5-47c9-90c8-00ecc6f5756a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:52.133606 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3c9b806c-ebd5-47c9-90c8-00ecc6f5756a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:52.135109 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3c9b806c-ebd5-47c9-90c8-00ecc6f5756a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:52.136265 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3c9b806c-ebd5-47c9-90c8-00ecc6f5756a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1407 microversion: 2.20 time: 0.156675 Jan 17 21:24:52.136858 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 299/599] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:24:51 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:24:53.155566 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4e3425e0-d27e-477c-b03e-d18b7f5c3cf0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:53.157128 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4e3425e0-d27e-477c-b03e-d18b7f5c3cf0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:53.163376 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4e3425e0-d27e-477c-b03e-d18b7f5c3cf0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:53.163839 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4e3425e0-d27e-477c-b03e-d18b7f5c3cf0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:53.164674 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4e3425e0-d27e-477c-b03e-d18b7f5c3cf0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:53.165121 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4e3425e0-d27e-477c-b03e-d18b7f5c3cf0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:53.397742 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4e3425e0-d27e-477c-b03e-d18b7f5c3cf0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:53.405956 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4e3425e0-d27e-477c-b03e-d18b7f5c3cf0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:53.407460 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4e3425e0-d27e-477c-b03e-d18b7f5c3cf0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:53.408597 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4e3425e0-d27e-477c-b03e-d18b7f5c3cf0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1407 microversion: 2.20 time: 0.257579 Jan 17 21:24:53.409157 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 301/600] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:24:53 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:24:54.123488 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-809156655", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452", "networks": [{"uuid": "43394bed-ee66-490e-9c2d-38204c292668"}]}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:24:54.179219 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.network.neutron [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] validate_networks() for [('43394bed-ee66-490e-9c2d-38204c292668', None, None, None, None, None)] {{(pid=116183) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:24:54.350916 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-806916625", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1095543640", "security_groups": [{"name": "tempest-secgroup-smoke-133141994"}], "networks": [{"uuid": "5dabefd5-55d4-49f2-9f4d-e4e0156bb858"}], "block_device_mapping_v2": [{"uuid": "3e312623-7a5d-4a99-8f80-beb222f63368", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:24:54.727233 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.network.neutron [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] validate_networks() for [('5dabefd5-55d4-49f2-9f4d-e4e0156bb858', None, None, None, None, None)] {{(pid=116182) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:24:54.808713 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Flavor limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:24:54.809199 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Image limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:24:54.809654 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Flavor pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:24:54.810064 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Image pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:24:54.810489 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:24:54.819645 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:54.820107 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:54.820967 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:54.821420 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:54.840093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Getting quotas for project f7ac0b68ef1544aa94c22825c7307849. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:24:54.844455 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Getting quotas for user 831aba98d11643aab4321dfa499e1d42 and project f7ac0b68ef1544aa94c22825c7307849. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:24:54.856107 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Going to run 1 instances... {{(pid=116183) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:24:54.858317 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:24:54.912551 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-19600179-ce3b-4c5d-a722-487f223ff139 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792422 Jan 17 21:24:54.913620 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 300/601] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:24:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:24:54.919183 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-cad35f63-9169-4a39-8a28-6c7ecae3314b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:54.919807 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-cad35f63-9169-4a39-8a28-6c7ecae3314b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:54.926215 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cad35f63-9169-4a39-8a28-6c7ecae3314b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:54.927299 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cad35f63-9169-4a39-8a28-6c7ecae3314b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:54.928109 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cad35f63-9169-4a39-8a28-6c7ecae3314b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:54.928601 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cad35f63-9169-4a39-8a28-6c7ecae3314b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:55.198356 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-cad35f63-9169-4a39-8a28-6c7ecae3314b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:55.215770 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-cad35f63-9169-4a39-8a28-6c7ecae3314b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:55.217615 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-cad35f63-9169-4a39-8a28-6c7ecae3314b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:55.218785 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-cad35f63-9169-4a39-8a28-6c7ecae3314b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1407 microversion: 2.20 time: 0.304415 Jan 17 21:24:55.219338 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 301/602] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:24:54 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:24:55.224285 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8998701a-ae47-4b1a-8ef1-42556e9aadc5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:55.225237 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8998701a-ae47-4b1a-8ef1-42556e9aadc5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:55.269539 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Flavor limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:24:55.270336 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Image limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:24:55.271123 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Flavor pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:24:55.272183 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Image pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:24:55.272964 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:24:55.297100 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:55.298481 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:55.300900 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:55.305130 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:55.318084 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8998701a-ae47-4b1a-8ef1-42556e9aadc5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:55.326426 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8998701a-ae47-4b1a-8ef1-42556e9aadc5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1218 microversion: 2.1 time: 0.105828 Jan 17 21:24:55.337018 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 302/603] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:55 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:55.344162 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Getting quotas for project 715ec979393344e694cfdd0eab44cb1c. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:24:55.348655 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Getting quotas for user 335e9c01fa8345f4bf1e14cce86abb2c and project 715ec979393344e694cfdd0eab44cb1c. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:24:55.444335 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Going to run 1 instances... {{(pid=116182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:24:55.447135 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e312623-7a5d-4a99-8f80-beb222f63368',volume_size=None,volume_type=None)] {{(pid=116182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:24:55.488286 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2246b55b-3ef7-44bf-9346-e4e695fab0c1 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c2665f8-4097-464f-b958-ff43450ee890"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:24:55.490219 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2246b55b-3ef7-44bf-9346-e4e695fab0c1 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:55.497738 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2246b55b-3ef7-44bf-9346-e4e695fab0c1 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:55.498714 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2246b55b-3ef7-44bf-9346-e4e695fab0c1 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:55.500482 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2246b55b-3ef7-44bf-9346-e4e695fab0c1 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:55.501716 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2246b55b-3ef7-44bf-9346-e4e695fab0c1 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:55.606065 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fe556874-7ca6-4a03-957f-61c3713068d9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.247659 Jan 17 21:24:55.607441 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 302/604] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:24:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:24:55.612340 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1472834916", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-577368355", "security_groups": [{"name": "tempest-secgroup-smoke-763362693"}], "block_device_mapping_v2": [{"uuid": "2290f6d9-ab41-4a47-80b8-dca70b6e32de", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5af0e6ef-b600-4363-b491-e83498d1d2b9"}]}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:24:55.744086 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.network.neutron [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] validate_networks() for [('5af0e6ef-b600-4363-b491-e83498d1d2b9', None, None, None, None, None)] {{(pid=116182) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:24:55.813820 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2246b55b-3ef7-44bf-9346-e4e695fab0c1 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "POST /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329284 Jan 17 21:24:55.814762 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 303/605] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jan 17 21:24:55 2022] POST /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:24:55.823985 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-16d8fa92-b189-4cf7-94f6-f8092ada815d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:55.826252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-16d8fa92-b189-4cf7-94f6-f8092ada815d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:55.924315 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-16d8fa92-b189-4cf7-94f6-f8092ada815d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:55.931409 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-16d8fa92-b189-4cf7-94f6-f8092ada815d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1088 microversion: 2.1 time: 0.115076 Jan 17 21:24:55.931979 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 304/606] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:55 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1088 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:56.256882 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5418db8c-a55a-41b7-91b4-6184e8721060 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:56.258323 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5418db8c-a55a-41b7-91b4-6184e8721060 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:56.268970 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5418db8c-a55a-41b7-91b4-6184e8721060 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:56.269831 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5418db8c-a55a-41b7-91b4-6184e8721060 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:56.272127 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5418db8c-a55a-41b7-91b4-6184e8721060 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:56.273398 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5418db8c-a55a-41b7-91b4-6184e8721060 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:56.305614 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Flavor limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:24:56.306670 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Image limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:24:56.307725 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Flavor pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:24:56.308809 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Image pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:24:56.309470 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:24:56.323144 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:56.324008 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:56.325040 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:56.325644 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:56.347200 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Getting quotas for project 97b00002d33945c6a8056483b241fbf6. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:24:56.362772 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Getting quotas for user 0cd489955c19471891724ec1badc11ee and project 97b00002d33945c6a8056483b241fbf6. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:24:56.437887 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Going to run 1 instances... {{(pid=116182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:24:56.439877 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2290f6d9-ab41-4a47-80b8-dca70b6e32de',volume_size=None,volume_type=None)] {{(pid=116182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:24:56.536548 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5418db8c-a55a-41b7-91b4-6184e8721060 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:56.545927 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5418db8c-a55a-41b7-91b4-6184e8721060 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:56.547451 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5418db8c-a55a-41b7-91b4-6184e8721060 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:56.549477 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5418db8c-a55a-41b7-91b4-6184e8721060 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1407 microversion: 2.20 time: 0.303486 Jan 17 21:24:56.550297 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 305/607] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:24:56 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:24:56.565551 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-52060aa8-7929-4637-835e-7cdde92586d5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:56.566519 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-52060aa8-7929-4637-835e-7cdde92586d5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:56.573230 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-52060aa8-7929-4637-835e-7cdde92586d5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:56.573782 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-52060aa8-7929-4637-835e-7cdde92586d5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:56.574639 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-52060aa8-7929-4637-835e-7cdde92586d5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:56.575090 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-52060aa8-7929-4637-835e-7cdde92586d5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:56.583204 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e2ef6acc-3378-4d0a-9b74-79533d8fd773 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.974454 Jan 17 21:24:56.584857 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 303/608] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:24:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:24:56.594628 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-410ca74f-49a3-42a8-8038-0458ac8fe7f9 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:56.595494 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-410ca74f-49a3-42a8-8038-0458ac8fe7f9 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:56.668259 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-52060aa8-7929-4637-835e-7cdde92586d5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:56.677110 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-52060aa8-7929-4637-835e-7cdde92586d5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1276 microversion: 2.1 time: 0.124916 Jan 17 21:24:56.677823 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 306/609] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:56 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1276 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:56.686518 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-410ca74f-49a3-42a8-8038-0458ac8fe7f9 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:56.696674 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-410ca74f-49a3-42a8-8038-0458ac8fe7f9 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1094 microversion: 2.1 time: 0.105596 Jan 17 21:24:56.697243 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 304/610] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:56 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1094 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:56.949198 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-11572162-3c38-4647-98c9-a72b9608cd59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:56.949947 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-11572162-3c38-4647-98c9-a72b9608cd59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:56.966033 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-11572162-3c38-4647-98c9-a72b9608cd59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:56.966884 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-11572162-3c38-4647-98c9-a72b9608cd59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:56.970115 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-11572162-3c38-4647-98c9-a72b9608cd59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:56.970831 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-11572162-3c38-4647-98c9-a72b9608cd59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:57.094582 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-11572162-3c38-4647-98c9-a72b9608cd59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:57.108873 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-11572162-3c38-4647-98c9-a72b9608cd59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1194 microversion: 2.1 time: 0.160179 Jan 17 21:24:57.109614 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 307/611] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:56 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1194 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:57.572949 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-85daf749-2029-4c0c-8f79-bda030a5a759 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:57.574264 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-85daf749-2029-4c0c-8f79-bda030a5a759 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:57.585385 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-85daf749-2029-4c0c-8f79-bda030a5a759 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:57.586402 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-85daf749-2029-4c0c-8f79-bda030a5a759 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:57.587082 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-85daf749-2029-4c0c-8f79-bda030a5a759 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:57.588769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-85daf749-2029-4c0c-8f79-bda030a5a759 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:57.696453 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8f1df906-1354-41ff-8768-0d9931d91c21 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:57.699080 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8f1df906-1354-41ff-8768-0d9931d91c21 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:57.710346 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8f1df906-1354-41ff-8768-0d9931d91c21 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:57.711169 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8f1df906-1354-41ff-8768-0d9931d91c21 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:57.712568 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8f1df906-1354-41ff-8768-0d9931d91c21 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:57.713238 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8f1df906-1354-41ff-8768-0d9931d91c21 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:57.972802 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-85daf749-2029-4c0c-8f79-bda030a5a759 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:57.982496 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-85daf749-2029-4c0c-8f79-bda030a5a759 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:57.983999 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-85daf749-2029-4c0c-8f79-bda030a5a759 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:57.985350 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-85daf749-2029-4c0c-8f79-bda030a5a759 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1407 microversion: 2.20 time: 0.420665 Jan 17 21:24:57.986102 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 305/612] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:24:57 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1407 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:24:57.991504 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3b905c95-44d6-4867-8f8e-2c99d8892be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:57.992966 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-3b905c95-44d6-4867-8f8e-2c99d8892be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:57.999223 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3b905c95-44d6-4867-8f8e-2c99d8892be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:57.999679 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3b905c95-44d6-4867-8f8e-2c99d8892be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:58.009282 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3b905c95-44d6-4867-8f8e-2c99d8892be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:58.009933 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3b905c95-44d6-4867-8f8e-2c99d8892be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:58.064420 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8f1df906-1354-41ff-8768-0d9931d91c21 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:58.075762 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8f1df906-1354-41ff-8768-0d9931d91c21 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1318 microversion: 2.1 time: 0.383734 Jan 17 21:24:58.077139 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 308/613] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:57 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:58.093567 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-3b905c95-44d6-4867-8f8e-2c99d8892be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:58.101043 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3b905c95-44d6-4867-8f8e-2c99d8892be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1210 microversion: 2.1 time: 0.113436 Jan 17 21:24:58.104792 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 306/614] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:57 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:58.127315 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3cbb0332-7feb-43bb-ba1c-99aaf7a2c967 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:58.128158 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3cbb0332-7feb-43bb-ba1c-99aaf7a2c967 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:58.135469 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3cbb0332-7feb-43bb-ba1c-99aaf7a2c967 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:58.136102 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3cbb0332-7feb-43bb-ba1c-99aaf7a2c967 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:58.136928 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3cbb0332-7feb-43bb-ba1c-99aaf7a2c967 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:58.137532 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3cbb0332-7feb-43bb-ba1c-99aaf7a2c967 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:58.236038 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-9a29d6c8-f971-4378-8e64-cd78d4bb3f4f req-c3ed5558-ec94-4e45-8e01-0c1f849050ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6219615-3cb9-44f4-9bc4-39c53d222a73", "tag": "b2392b89-5cea-4346-bc5a-c8675b50ddc3"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:24:58.241584 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:24:58.241584 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:24:58.248608 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-9a29d6c8-f971-4378-8e64-cd78d4bb3f4f req-c3ed5558-ec94-4e45-8e01-0c1f849050ac service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:58.249285 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-9a29d6c8-f971-4378-8e64-cd78d4bb3f4f req-c3ed5558-ec94-4e45-8e01-0c1f849050ac service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:58.267930 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-9a29d6c8-f971-4378-8e64-cd78d4bb3f4f req-c3ed5558-ec94-4e45-8e01-0c1f849050ac service nova] Creating event network-changed:b2392b89-5cea-4346-bc5a-c8675b50ddc3 for instance d6219615-3cb9-44f4-9bc4-39c53d222a73 on hv-cinder-82489 Jan 17 21:24:58.273879 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-9a29d6c8-f971-4378-8e64-cd78d4bb3f4f req-c3ed5558-ec94-4e45-8e01-0c1f849050ac service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045922 Jan 17 21:24:58.274800 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 307/615] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:58.349718 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3cbb0332-7feb-43bb-ba1c-99aaf7a2c967 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:58.358326 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3cbb0332-7feb-43bb-ba1c-99aaf7a2c967 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1271 microversion: 2.1 time: 0.235218 Jan 17 21:24:58.358904 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 309/616] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:58 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:59.004163 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f1d3722a-a01f-4ff1-97cc-1fedf28df152 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:59.005803 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f1d3722a-a01f-4ff1-97cc-1fedf28df152 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:59.013738 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f1d3722a-a01f-4ff1-97cc-1fedf28df152 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:59.015708 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f1d3722a-a01f-4ff1-97cc-1fedf28df152 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:59.016748 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f1d3722a-a01f-4ff1-97cc-1fedf28df152 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:59.017274 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f1d3722a-a01f-4ff1-97cc-1fedf28df152 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:59.096857 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-83c347c8-48f8-4c70-922e-c60548765086 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:59.107161 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-83c347c8-48f8-4c70-922e-c60548765086 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:59.127460 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83c347c8-48f8-4c70-922e-c60548765086 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:59.128493 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83c347c8-48f8-4c70-922e-c60548765086 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:59.131316 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83c347c8-48f8-4c70-922e-c60548765086 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:59.132043 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83c347c8-48f8-4c70-922e-c60548765086 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:59.665255 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f1d3722a-a01f-4ff1-97cc-1fedf28df152 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:59.677137 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f1d3722a-a01f-4ff1-97cc-1fedf28df152 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:59.679009 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f1d3722a-a01f-4ff1-97cc-1fedf28df152 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:59.680463 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f1d3722a-a01f-4ff1-97cc-1fedf28df152 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1407 microversion: 2.20 time: 0.680596 Jan 17 21:24:59.681551 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 308/617] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:24:58 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1407 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:24:59.686567 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d0576882-4e85-4a1b-9df8-ae9444e09b8f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:59.687398 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d0576882-4e85-4a1b-9df8-ae9444e09b8f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:59.697399 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0576882-4e85-4a1b-9df8-ae9444e09b8f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:59.698060 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0576882-4e85-4a1b-9df8-ae9444e09b8f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:59.699098 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0576882-4e85-4a1b-9df8-ae9444e09b8f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:59.699707 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0576882-4e85-4a1b-9df8-ae9444e09b8f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:59.720243 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-83c347c8-48f8-4c70-922e-c60548765086 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:59.735672 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-83c347c8-48f8-4c70-922e-c60548765086 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1318 microversion: 2.1 time: 0.645319 Jan 17 21:24:59.737160 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 310/618] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:59 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1318 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:59.742963 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-e25ab0d3-ba84-4f24-a33a-1c799729c550 req-52942551-46df-45a2-813c-42b7bf1128c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a05a7cb-fb38-46fe-a04b-f8c66845fbd8", "tag": "858678d3-306c-4afa-9059-494f90b38571"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:24:59.744632 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:24:59.744632 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:24:59.752498 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-e25ab0d3-ba84-4f24-a33a-1c799729c550 req-52942551-46df-45a2-813c-42b7bf1128c4 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:59.753213 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-e25ab0d3-ba84-4f24-a33a-1c799729c550 req-52942551-46df-45a2-813c-42b7bf1128c4 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:59.778195 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-e25ab0d3-ba84-4f24-a33a-1c799729c550 req-52942551-46df-45a2-813c-42b7bf1128c4 service nova] Creating event network-changed:858678d3-306c-4afa-9059-494f90b38571 for instance 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 on hv-cinder-82489 Jan 17 21:24:59.784635 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-e25ab0d3-ba84-4f24-a33a-1c799729c550 req-52942551-46df-45a2-813c-42b7bf1128c4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045785 Jan 17 21:24:59.786535 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 311/619] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:24:59.794047 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-632f8ec3-4d4a-41b5-a962-a2a9972aad03 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:24:59.796501 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-632f8ec3-4d4a-41b5-a962-a2a9972aad03 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:24:59.808570 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-632f8ec3-4d4a-41b5-a962-a2a9972aad03 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:59.809042 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-632f8ec3-4d4a-41b5-a962-a2a9972aad03 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:59.810000 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-632f8ec3-4d4a-41b5-a962-a2a9972aad03 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:24:59.810491 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-632f8ec3-4d4a-41b5-a962-a2a9972aad03 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:24:59.902814 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d0576882-4e85-4a1b-9df8-ae9444e09b8f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:59.910577 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d0576882-4e85-4a1b-9df8-ae9444e09b8f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1277 microversion: 2.1 time: 0.227594 Jan 17 21:24:59.911385 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 309/620] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:59 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:24:59.991567 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-632f8ec3-4d4a-41b5-a962-a2a9972aad03 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:24:59.999860 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-632f8ec3-4d4a-41b5-a962-a2a9972aad03 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1271 microversion: 2.1 time: 0.211562 Jan 17 21:25:00.000608 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 312/621] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:24:59 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1271 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:00.699014 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-606b7173-7e9f-4419-be6a-1f752a9a768b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:00.700798 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-606b7173-7e9f-4419-be6a-1f752a9a768b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:00.717282 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-606b7173-7e9f-4419-be6a-1f752a9a768b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:00.718253 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-606b7173-7e9f-4419-be6a-1f752a9a768b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:00.719447 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-606b7173-7e9f-4419-be6a-1f752a9a768b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:00.720056 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-606b7173-7e9f-4419-be6a-1f752a9a768b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:00.757133 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-309d4dd4-3b74-490d-a321-cef4ae116faf tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:00.758362 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-309d4dd4-3b74-490d-a321-cef4ae116faf tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:00.765916 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-309d4dd4-3b74-490d-a321-cef4ae116faf tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:00.768427 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-309d4dd4-3b74-490d-a321-cef4ae116faf tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:00.769623 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-309d4dd4-3b74-490d-a321-cef4ae116faf tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:00.770268 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-309d4dd4-3b74-490d-a321-cef4ae116faf tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:00.978385 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-606b7173-7e9f-4419-be6a-1f752a9a768b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:01.005692 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-606b7173-7e9f-4419-be6a-1f752a9a768b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:01.005858 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-309d4dd4-3b74-490d-a321-cef4ae116faf tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:01.007511 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-606b7173-7e9f-4419-be6a-1f752a9a768b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:01.009242 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-606b7173-7e9f-4419-be6a-1f752a9a768b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1407 microversion: 2.20 time: 0.314290 Jan 17 21:25:01.010073 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 310/622] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:25:00 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:25:01.015341 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-309d4dd4-3b74-490d-a321-cef4ae116faf tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1318 microversion: 2.1 time: 0.261790 Jan 17 21:25:01.015578 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fd5f2058-53a0-4cb7-99e6-ba13c404e510 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:01.016048 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fd5f2058-53a0-4cb7-99e6-ba13c404e510 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:01.016180 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 313/623] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:00 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:01.022019 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-025ade0c-a040-4f5c-bb1e-ec01e9624db5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:01.022843 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-025ade0c-a040-4f5c-bb1e-ec01e9624db5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:01.032705 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd5f2058-53a0-4cb7-99e6-ba13c404e510 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:01.032705 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd5f2058-53a0-4cb7-99e6-ba13c404e510 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:01.032705 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd5f2058-53a0-4cb7-99e6-ba13c404e510 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:01.032705 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd5f2058-53a0-4cb7-99e6-ba13c404e510 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:01.041904 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-025ade0c-a040-4f5c-bb1e-ec01e9624db5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:01.042470 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-025ade0c-a040-4f5c-bb1e-ec01e9624db5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:01.043436 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-025ade0c-a040-4f5c-bb1e-ec01e9624db5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:01.043965 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-025ade0c-a040-4f5c-bb1e-ec01e9624db5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:01.304960 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-fd5f2058-53a0-4cb7-99e6-ba13c404e510 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:01.317804 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-025ade0c-a040-4f5c-bb1e-ec01e9624db5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:01.321316 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fd5f2058-53a0-4cb7-99e6-ba13c404e510 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1277 microversion: 2.1 time: 0.309279 Jan 17 21:25:01.321873 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 311/624] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:01 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1277 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:01.327800 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-025ade0c-a040-4f5c-bb1e-ec01e9624db5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1271 microversion: 2.1 time: 0.310416 Jan 17 21:25:01.328746 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 314/625] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:01 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1271 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:01.865765 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-646e602a-b74e-40fd-ac50-8e942f1131ba req-a7f08113-90f3-4a90-9b17-05ceb5f465ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "851b3dd1-961b-4d23-9594-2a55d4f0f703", "tag": "bfd59a07-416c-4292-b1be-059ed60c472c"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:01.868836 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:25:01.868836 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:25:01.881110 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-646e602a-b74e-40fd-ac50-8e942f1131ba req-a7f08113-90f3-4a90-9b17-05ceb5f465ad service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:01.882773 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-646e602a-b74e-40fd-ac50-8e942f1131ba req-a7f08113-90f3-4a90-9b17-05ceb5f465ad service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:01.894406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-646e602a-b74e-40fd-ac50-8e942f1131ba req-a7f08113-90f3-4a90-9b17-05ceb5f465ad service nova] Creating event network-changed:bfd59a07-416c-4292-b1be-059ed60c472c for instance 851b3dd1-961b-4d23-9594-2a55d4f0f703 on hv-cinder-82489 Jan 17 21:25:01.899513 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-646e602a-b74e-40fd-ac50-8e942f1131ba req-a7f08113-90f3-4a90-9b17-05ceb5f465ad service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041501 Jan 17 21:25:01.900125 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 312/626] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:25:02.028526 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2266f520-0b52-4981-a319-57a526ff6ce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:02.030417 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2266f520-0b52-4981-a319-57a526ff6ce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:02.032487 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-600211d0-16ec-40d3-b320-6fdc966ed079 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:02.033411 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-600211d0-16ec-40d3-b320-6fdc966ed079 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:02.038915 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2266f520-0b52-4981-a319-57a526ff6ce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:02.039664 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2266f520-0b52-4981-a319-57a526ff6ce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:02.040571 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2266f520-0b52-4981-a319-57a526ff6ce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:02.040831 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-600211d0-16ec-40d3-b320-6fdc966ed079 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:02.041191 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2266f520-0b52-4981-a319-57a526ff6ce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:02.041465 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-600211d0-16ec-40d3-b320-6fdc966ed079 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:02.042428 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-600211d0-16ec-40d3-b320-6fdc966ed079 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:02.043039 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-600211d0-16ec-40d3-b320-6fdc966ed079 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:02.269540 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2266f520-0b52-4981-a319-57a526ff6ce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:02.271641 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-600211d0-16ec-40d3-b320-6fdc966ed079 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:02.279105 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-600211d0-16ec-40d3-b320-6fdc966ed079 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1318 microversion: 2.1 time: 0.250387 Jan 17 21:25:02.279951 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 313/627] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:02 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:02.284159 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2266f520-0b52-4981-a319-57a526ff6ce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:02.285800 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2266f520-0b52-4981-a319-57a526ff6ce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:02.287000 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2266f520-0b52-4981-a319-57a526ff6ce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1407 microversion: 2.20 time: 0.262269 Jan 17 21:25:02.288511 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 315/628] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:25:02 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:25:02.338256 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-32c8f88d-86c1-42c0-8259-141760d472a7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:02.339133 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-32c8f88d-86c1-42c0-8259-141760d472a7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:02.345335 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-32c8f88d-86c1-42c0-8259-141760d472a7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:02.345796 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-32c8f88d-86c1-42c0-8259-141760d472a7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:02.346596 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-32c8f88d-86c1-42c0-8259-141760d472a7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:02.346926 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-84a0d56a-85be-4023-a24a-bcdb861420fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:02.347054 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-32c8f88d-86c1-42c0-8259-141760d472a7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:02.347529 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-84a0d56a-85be-4023-a24a-bcdb861420fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:02.354662 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-84a0d56a-85be-4023-a24a-bcdb861420fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:02.355472 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-84a0d56a-85be-4023-a24a-bcdb861420fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:02.356267 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-84a0d56a-85be-4023-a24a-bcdb861420fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:02.356787 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-84a0d56a-85be-4023-a24a-bcdb861420fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:02.575298 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-32c8f88d-86c1-42c0-8259-141760d472a7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:02.583956 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-32c8f88d-86c1-42c0-8259-141760d472a7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1277 microversion: 2.1 time: 0.249923 Jan 17 21:25:02.586359 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-84a0d56a-85be-4023-a24a-bcdb861420fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:02.592913 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 314/629] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:02 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:02.594600 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-84a0d56a-85be-4023-a24a-bcdb861420fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1271 microversion: 2.1 time: 0.251250 Jan 17 21:25:02.595182 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 316/630] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:02 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:03.296593 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4eff1e2b-7c69-495b-b686-52b1f1f07f3c tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:03.297215 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4eff1e2b-7c69-495b-b686-52b1f1f07f3c tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:03.305177 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4eff1e2b-7c69-495b-b686-52b1f1f07f3c tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:03.305666 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4eff1e2b-7c69-495b-b686-52b1f1f07f3c tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:03.306509 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4eff1e2b-7c69-495b-b686-52b1f1f07f3c tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:03.306912 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4eff1e2b-7c69-495b-b686-52b1f1f07f3c tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:03.307763 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7a43548d-5e9d-4a5b-8056-75e93b0229d2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:03.308578 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7a43548d-5e9d-4a5b-8056-75e93b0229d2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:03.315322 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7a43548d-5e9d-4a5b-8056-75e93b0229d2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:03.315944 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7a43548d-5e9d-4a5b-8056-75e93b0229d2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:03.317527 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7a43548d-5e9d-4a5b-8056-75e93b0229d2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:03.318086 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7a43548d-5e9d-4a5b-8056-75e93b0229d2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:03.525252 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4eff1e2b-7c69-495b-b686-52b1f1f07f3c tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:03.532560 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4eff1e2b-7c69-495b-b686-52b1f1f07f3c tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1318 microversion: 2.1 time: 0.240654 Jan 17 21:25:03.533072 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 315/631] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:03 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:03.540960 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7a43548d-5e9d-4a5b-8056-75e93b0229d2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:03.549330 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7a43548d-5e9d-4a5b-8056-75e93b0229d2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:03.550826 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7a43548d-5e9d-4a5b-8056-75e93b0229d2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:03.552615 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7a43548d-5e9d-4a5b-8056-75e93b0229d2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1407 microversion: 2.20 time: 0.249602 Jan 17 21:25:03.553392 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 317/632] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:25:03 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:25:03.599492 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-92ee5ac4-118e-4614-8e5c-bde59e8f9c09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:03.600102 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-92ee5ac4-118e-4614-8e5c-bde59e8f9c09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:03.607844 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-92ee5ac4-118e-4614-8e5c-bde59e8f9c09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:03.608676 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-92ee5ac4-118e-4614-8e5c-bde59e8f9c09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:03.609774 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-92ee5ac4-118e-4614-8e5c-bde59e8f9c09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:03.610466 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-92ee5ac4-118e-4614-8e5c-bde59e8f9c09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:03.610683 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4c312fb5-983d-4021-bcf8-a312da91b3e5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:03.611305 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4c312fb5-983d-4021-bcf8-a312da91b3e5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:03.619939 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c312fb5-983d-4021-bcf8-a312da91b3e5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:03.620419 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c312fb5-983d-4021-bcf8-a312da91b3e5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:03.621402 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c312fb5-983d-4021-bcf8-a312da91b3e5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:03.622010 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c312fb5-983d-4021-bcf8-a312da91b3e5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:03.821574 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-92ee5ac4-118e-4614-8e5c-bde59e8f9c09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:03.830327 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-92ee5ac4-118e-4614-8e5c-bde59e8f9c09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1277 microversion: 2.1 time: 0.234349 Jan 17 21:25:03.831006 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 316/633] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:03 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1277 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:03.837646 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-aaed2d1a-8909-4cd0-b1c3-f3e370178821 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:03.838403 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-aaed2d1a-8909-4cd0-b1c3-f3e370178821 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:03.842936 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4c312fb5-983d-4021-bcf8-a312da91b3e5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:03.845440 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-aaed2d1a-8909-4cd0-b1c3-f3e370178821 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:03.846488 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-aaed2d1a-8909-4cd0-b1c3-f3e370178821 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:03.847404 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-aaed2d1a-8909-4cd0-b1c3-f3e370178821 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:03.848637 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-aaed2d1a-8909-4cd0-b1c3-f3e370178821 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:03.850930 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4c312fb5-983d-4021-bcf8-a312da91b3e5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.243946 Jan 17 21:25:03.860270 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 318/634] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:03 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:03.944930 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-aaed2d1a-8909-4cd0-b1c3-f3e370178821 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lazy-loading 'services' on Instance uuid 67bca008-58c3-469e-bda3-bbb2b89fa9be {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:25:04.015084 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-aaed2d1a-8909-4cd0-b1c3-f3e370178821 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "DELETE /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be/os-volume_attachments/8c2665f8-4097-464f-b958-ff43450ee890" status: 202 len: 0 microversion: 2.1 time: 0.182627 Jan 17 21:25:04.016530 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 317/635] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jan 17 21:25:03 2022] DELETE /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be/os-volume_attachments/8c2665f8-4097-464f-b958-ff43450ee890 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:25:04.024195 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5a6dfc4a-7b3b-4a2d-ae2f-ec7ab83addf5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:04.025191 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5a6dfc4a-7b3b-4a2d-ae2f-ec7ab83addf5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:04.031435 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5a6dfc4a-7b3b-4a2d-ae2f-ec7ab83addf5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:04.031900 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5a6dfc4a-7b3b-4a2d-ae2f-ec7ab83addf5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:04.032790 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5a6dfc4a-7b3b-4a2d-ae2f-ec7ab83addf5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:04.033236 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5a6dfc4a-7b3b-4a2d-ae2f-ec7ab83addf5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:04.067408 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5a6dfc4a-7b3b-4a2d-ae2f-ec7ab83addf5 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047384 Jan 17 21:25:04.067961 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 319/636] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:25:04 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:25:04.553894 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c7ba79a7-173c-4dd3-a0bf-669230299abd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:04.554605 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c7ba79a7-173c-4dd3-a0bf-669230299abd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:04.561676 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c7ba79a7-173c-4dd3-a0bf-669230299abd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:04.562139 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c7ba79a7-173c-4dd3-a0bf-669230299abd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:04.562941 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c7ba79a7-173c-4dd3-a0bf-669230299abd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:04.563396 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c7ba79a7-173c-4dd3-a0bf-669230299abd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:04.572815 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c0cda821-590c-4817-ba6e-be7c6c1a4f43 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:04.573423 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c0cda821-590c-4817-ba6e-be7c6c1a4f43 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:04.579777 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c0cda821-590c-4817-ba6e-be7c6c1a4f43 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:04.580237 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c0cda821-590c-4817-ba6e-be7c6c1a4f43 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:04.581078 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c0cda821-590c-4817-ba6e-be7c6c1a4f43 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:04.581522 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c0cda821-590c-4817-ba6e-be7c6c1a4f43 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:04.764983 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c7ba79a7-173c-4dd3-a0bf-669230299abd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:04.776234 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-c0cda821-590c-4817-ba6e-be7c6c1a4f43 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:04.784566 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-c0cda821-590c-4817-ba6e-be7c6c1a4f43 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:04.786235 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c7ba79a7-173c-4dd3-a0bf-669230299abd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1318 microversion: 2.1 time: 0.238156 Jan 17 21:25:04.788350 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-c0cda821-590c-4817-ba6e-be7c6c1a4f43 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:04.789381 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c0cda821-590c-4817-ba6e-be7c6c1a4f43 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1407 microversion: 2.20 time: 0.220210 Jan 17 21:25:04.789933 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 320/637] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:25:04 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:25:04.790434 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 318/638] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:04 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:04.848106 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-09bc0f91-e7f3-40ad-9849-e6a65bbe1dc6 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:04.848902 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-09bc0f91-e7f3-40ad-9849-e6a65bbe1dc6 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:04.856198 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-09bc0f91-e7f3-40ad-9849-e6a65bbe1dc6 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:04.856975 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-09bc0f91-e7f3-40ad-9849-e6a65bbe1dc6 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:04.858743 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-09bc0f91-e7f3-40ad-9849-e6a65bbe1dc6 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:04.859193 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-09bc0f91-e7f3-40ad-9849-e6a65bbe1dc6 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:04.866208 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-1d07f7b2-9166-4634-b328-c1f55284fd21 req-e6a0f4e2-e87b-4447-a1eb-4f022fd08c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5edb3c99-d30d-4a2c-8b50-5083b7ea9d96", "name": "network-vif-plugged", "status": "completed", "tag": "dde4fe76-f1d0-4978-a642-2a35761fdf74"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:04.868507 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:25:04.868507 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:25:04.876215 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-1d07f7b2-9166-4634-b328-c1f55284fd21 req-e6a0f4e2-e87b-4447-a1eb-4f022fd08c35 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:04.876811 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-1d07f7b2-9166-4634-b328-c1f55284fd21 req-e6a0f4e2-e87b-4447-a1eb-4f022fd08c35 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:04.889933 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-1d07f7b2-9166-4634-b328-c1f55284fd21 req-e6a0f4e2-e87b-4447-a1eb-4f022fd08c35 service nova] Creating event network-vif-plugged:dde4fe76-f1d0-4978-a642-2a35761fdf74 for instance 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 on hv-cinder-82489 Jan 17 21:25:04.896830 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-1d07f7b2-9166-4634-b328-c1f55284fd21 req-e6a0f4e2-e87b-4447-a1eb-4f022fd08c35 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037661 Jan 17 21:25:04.898048 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 321/639] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:25:04.903361 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4ecf68e9-2e3a-4cbb-ac7e-126fdfa21345 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:04.904279 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4ecf68e9-2e3a-4cbb-ac7e-126fdfa21345 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:04.914431 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4ecf68e9-2e3a-4cbb-ac7e-126fdfa21345 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:04.915251 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4ecf68e9-2e3a-4cbb-ac7e-126fdfa21345 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:04.916363 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4ecf68e9-2e3a-4cbb-ac7e-126fdfa21345 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:04.917381 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4ecf68e9-2e3a-4cbb-ac7e-126fdfa21345 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:05.128176 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-09bc0f91-e7f3-40ad-9849-e6a65bbe1dc6 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:05.137721 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-09bc0f91-e7f3-40ad-9849-e6a65bbe1dc6 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.294425 Jan 17 21:25:05.144498 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4ecf68e9-2e3a-4cbb-ac7e-126fdfa21345 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:05.148750 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 319/640] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:04 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:05.153233 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4ecf68e9-2e3a-4cbb-ac7e-126fdfa21345 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.253762 Jan 17 21:25:05.153801 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 322/641] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:04 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:05.163152 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2862151c-df9d-42a7-80c2-95a22ec1fc31 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:05.164279 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2862151c-df9d-42a7-80c2-95a22ec1fc31 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:05.170349 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2862151c-df9d-42a7-80c2-95a22ec1fc31 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:05.170769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2862151c-df9d-42a7-80c2-95a22ec1fc31 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:05.171570 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2862151c-df9d-42a7-80c2-95a22ec1fc31 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:05.172257 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2862151c-df9d-42a7-80c2-95a22ec1fc31 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:05.202601 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2862151c-df9d-42a7-80c2-95a22ec1fc31 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052456 Jan 17 21:25:05.203324 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 320/642] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:25:05 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:25:05.807406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f8c2948a-c9b6-44ee-a9a1-9a24b782afd5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:05.808045 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e9d1ab0b-e46d-47fa-bfb0-bc5b7cb152f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:05.808417 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-e9d1ab0b-e46d-47fa-bfb0-bc5b7cb152f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:05.808541 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f8c2948a-c9b6-44ee-a9a1-9a24b782afd5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:05.814493 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f8c2948a-c9b6-44ee-a9a1-9a24b782afd5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:05.814683 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e9d1ab0b-e46d-47fa-bfb0-bc5b7cb152f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:05.815057 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f8c2948a-c9b6-44ee-a9a1-9a24b782afd5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:05.815184 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e9d1ab0b-e46d-47fa-bfb0-bc5b7cb152f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:05.815887 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f8c2948a-c9b6-44ee-a9a1-9a24b782afd5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:05.816246 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e9d1ab0b-e46d-47fa-bfb0-bc5b7cb152f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:05.816408 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f8c2948a-c9b6-44ee-a9a1-9a24b782afd5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:05.819364 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e9d1ab0b-e46d-47fa-bfb0-bc5b7cb152f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:06.026024 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f8c2948a-c9b6-44ee-a9a1-9a24b782afd5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:06.030041 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-e9d1ab0b-e46d-47fa-bfb0-bc5b7cb152f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:06.036159 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f8c2948a-c9b6-44ee-a9a1-9a24b782afd5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1318 microversion: 2.1 time: 0.231663 Jan 17 21:25:06.036789 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 321/643] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:05 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:06.038535 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-e9d1ab0b-e46d-47fa-bfb0-bc5b7cb152f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:06.040182 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-e9d1ab0b-e46d-47fa-bfb0-bc5b7cb152f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:06.052447 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e9d1ab0b-e46d-47fa-bfb0-bc5b7cb152f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1407 microversion: 2.20 time: 0.237444 Jan 17 21:25:06.052447 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 323/644] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:25:05 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:25:06.156102 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c499cd24-08fa-4e80-b34e-40185b844577 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:06.156786 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c499cd24-08fa-4e80-b34e-40185b844577 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:06.162871 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c499cd24-08fa-4e80-b34e-40185b844577 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:06.163416 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c499cd24-08fa-4e80-b34e-40185b844577 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:06.164163 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c499cd24-08fa-4e80-b34e-40185b844577 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:06.164634 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c499cd24-08fa-4e80-b34e-40185b844577 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:06.171602 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-52bb1ac8-c585-4c6b-8073-cf5b3abe8056 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:06.172306 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-52bb1ac8-c585-4c6b-8073-cf5b3abe8056 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:06.180191 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-52bb1ac8-c585-4c6b-8073-cf5b3abe8056 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:06.181061 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-52bb1ac8-c585-4c6b-8073-cf5b3abe8056 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:06.182116 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-52bb1ac8-c585-4c6b-8073-cf5b3abe8056 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:06.182923 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-52bb1ac8-c585-4c6b-8073-cf5b3abe8056 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:06.391280 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c499cd24-08fa-4e80-b34e-40185b844577 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:06.399772 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c499cd24-08fa-4e80-b34e-40185b844577 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.247143 Jan 17 21:25:06.400544 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 322/645] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:06 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:06.405270 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5f25b6f5-27d1-4d9b-8fc6-f77625bbed5f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:06.406399 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5f25b6f5-27d1-4d9b-8fc6-f77625bbed5f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:06.412112 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-52bb1ac8-c585-4c6b-8073-cf5b3abe8056 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:06.412283 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5f25b6f5-27d1-4d9b-8fc6-f77625bbed5f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:06.412741 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5f25b6f5-27d1-4d9b-8fc6-f77625bbed5f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:06.413519 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5f25b6f5-27d1-4d9b-8fc6-f77625bbed5f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:06.413953 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5f25b6f5-27d1-4d9b-8fc6-f77625bbed5f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:06.421969 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-52bb1ac8-c585-4c6b-8073-cf5b3abe8056 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.255486 Jan 17 21:25:06.423309 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 324/646] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:06 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:06.449838 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5f25b6f5-27d1-4d9b-8fc6-f77625bbed5f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048013 Jan 17 21:25:06.450399 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 323/647] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:25:06 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:25:06.918739 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-9a372f78-53b0-44c0-bab6-10a1afa9c84c req-9a9d2f35-14cb-4aaf-87ab-ba4795055aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6219615-3cb9-44f4-9bc4-39c53d222a73", "name": "network-vif-plugged", "status": "completed", "tag": "b2392b89-5cea-4346-bc5a-c8675b50ddc3"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:06.920309 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:25:06.920309 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:25:06.927980 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-9a372f78-53b0-44c0-bab6-10a1afa9c84c req-9a9d2f35-14cb-4aaf-87ab-ba4795055aff service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:06.928458 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-9a372f78-53b0-44c0-bab6-10a1afa9c84c req-9a9d2f35-14cb-4aaf-87ab-ba4795055aff service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:06.939131 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-9a372f78-53b0-44c0-bab6-10a1afa9c84c req-9a9d2f35-14cb-4aaf-87ab-ba4795055aff service nova] Creating event network-vif-plugged:b2392b89-5cea-4346-bc5a-c8675b50ddc3 for instance d6219615-3cb9-44f4-9bc4-39c53d222a73 on hv-cinder-82489 Jan 17 21:25:06.943849 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-9a372f78-53b0-44c0-bab6-10a1afa9c84c req-9a9d2f35-14cb-4aaf-87ab-ba4795055aff service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028696 Jan 17 21:25:06.944534 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 325/648] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:25:07.060930 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4e9acb25-8cd5-4ed4-b967-a72ef5ca8369 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:07.061587 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4e9acb25-8cd5-4ed4-b967-a72ef5ca8369 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:07.068055 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-afee2922-b518-438a-8ba6-4925f759efa0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:07.068219 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4e9acb25-8cd5-4ed4-b967-a72ef5ca8369 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:07.068592 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4e9acb25-8cd5-4ed4-b967-a72ef5ca8369 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:07.068779 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-afee2922-b518-438a-8ba6-4925f759efa0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:07.069395 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4e9acb25-8cd5-4ed4-b967-a72ef5ca8369 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:07.069839 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4e9acb25-8cd5-4ed4-b967-a72ef5ca8369 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:07.075831 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-afee2922-b518-438a-8ba6-4925f759efa0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:07.076279 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-afee2922-b518-438a-8ba6-4925f759efa0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:07.077093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-afee2922-b518-438a-8ba6-4925f759efa0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:07.077526 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-afee2922-b518-438a-8ba6-4925f759efa0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:07.265755 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4e9acb25-8cd5-4ed4-b967-a72ef5ca8369 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:07.273369 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-afee2922-b518-438a-8ba6-4925f759efa0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:07.273771 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4e9acb25-8cd5-4ed4-b967-a72ef5ca8369 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:07.275311 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4e9acb25-8cd5-4ed4-b967-a72ef5ca8369 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:07.276448 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4e9acb25-8cd5-4ed4-b967-a72ef5ca8369 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1407 microversion: 2.20 time: 0.219255 Jan 17 21:25:07.277010 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 324/649] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:25:07 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:25:07.281274 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-afee2922-b518-438a-8ba6-4925f759efa0 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1318 microversion: 2.1 time: 0.217123 Jan 17 21:25:07.281833 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 326/650] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:07 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:07.416908 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f4451871-90d1-48b5-b6fc-649dd1a815b5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:07.417545 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f4451871-90d1-48b5-b6fc-649dd1a815b5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:07.423455 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f4451871-90d1-48b5-b6fc-649dd1a815b5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:07.423906 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f4451871-90d1-48b5-b6fc-649dd1a815b5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:07.424730 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f4451871-90d1-48b5-b6fc-649dd1a815b5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:07.425171 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f4451871-90d1-48b5-b6fc-649dd1a815b5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:07.440401 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-dfe34204-e806-4a4a-86db-009e031a3c8f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:07.441038 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-dfe34204-e806-4a4a-86db-009e031a3c8f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:07.447005 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dfe34204-e806-4a4a-86db-009e031a3c8f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:07.447399 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dfe34204-e806-4a4a-86db-009e031a3c8f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:07.448194 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dfe34204-e806-4a4a-86db-009e031a3c8f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:07.448676 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dfe34204-e806-4a4a-86db-009e031a3c8f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:07.625935 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f4451871-90d1-48b5-b6fc-649dd1a815b5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:07.631534 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-dfe34204-e806-4a4a-86db-009e031a3c8f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:07.634262 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f4451871-90d1-48b5-b6fc-649dd1a815b5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.220898 Jan 17 21:25:07.635047 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 325/651] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:07 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:07.639402 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-dfe34204-e806-4a4a-86db-009e031a3c8f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.203316 Jan 17 21:25:07.640286 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 327/652] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:07 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:08.294227 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2729eb69-86d8-4296-b39e-b1fe50482127 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:08.294748 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2729eb69-86d8-4296-b39e-b1fe50482127 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:08.297789 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8ddaa57f-2d8f-4114-a992-1201f3f0acf2 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:08.298444 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8ddaa57f-2d8f-4114-a992-1201f3f0acf2 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:08.301379 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2729eb69-86d8-4296-b39e-b1fe50482127 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:08.301765 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2729eb69-86d8-4296-b39e-b1fe50482127 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:08.302564 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2729eb69-86d8-4296-b39e-b1fe50482127 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:08.303016 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2729eb69-86d8-4296-b39e-b1fe50482127 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:08.305221 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8ddaa57f-2d8f-4114-a992-1201f3f0acf2 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:08.305685 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8ddaa57f-2d8f-4114-a992-1201f3f0acf2 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:08.306472 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8ddaa57f-2d8f-4114-a992-1201f3f0acf2 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:08.306924 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8ddaa57f-2d8f-4114-a992-1201f3f0acf2 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:08.494122 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2729eb69-86d8-4296-b39e-b1fe50482127 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:08.498105 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8ddaa57f-2d8f-4114-a992-1201f3f0acf2 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:08.502019 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2729eb69-86d8-4296-b39e-b1fe50482127 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:08.503522 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2729eb69-86d8-4296-b39e-b1fe50482127 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:08.505289 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2729eb69-86d8-4296-b39e-b1fe50482127 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1600 microversion: 2.20 time: 0.214866 Jan 17 21:25:08.505861 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 326/653] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:25:08 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:25:08.506505 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8ddaa57f-2d8f-4114-a992-1201f3f0acf2 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1318 microversion: 2.1 time: 0.212273 Jan 17 21:25:08.507152 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 328/654] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:08 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:08.522755 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-094e91d3-7f4c-47a9-86fe-fa2d728299db tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:08.523253 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-094e91d3-7f4c-47a9-86fe-fa2d728299db tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:08.529248 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-094e91d3-7f4c-47a9-86fe-fa2d728299db tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:08.529701 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-094e91d3-7f4c-47a9-86fe-fa2d728299db tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:08.530486 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-094e91d3-7f4c-47a9-86fe-fa2d728299db tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:08.530928 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-094e91d3-7f4c-47a9-86fe-fa2d728299db tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:08.610147 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-094e91d3-7f4c-47a9-86fe-fa2d728299db tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091413 Jan 17 21:25:08.610749 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 327/655] 10.222.0.64 () {60 vars in 1315 bytes} [Mon Jan 17 21:25:08 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:25:08.650799 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1edfb747-08b4-4bb4-81ce-9785c5d0ba19 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:08.651406 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1edfb747-08b4-4bb4-81ce-9785c5d0ba19 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:08.658632 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5c1864ea-5d62-4c15-9e36-b464d7d64424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:08.658909 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1edfb747-08b4-4bb4-81ce-9785c5d0ba19 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:08.659238 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5c1864ea-5d62-4c15-9e36-b464d7d64424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:08.659352 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1edfb747-08b4-4bb4-81ce-9785c5d0ba19 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:08.660156 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1edfb747-08b4-4bb4-81ce-9785c5d0ba19 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:08.662016 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1edfb747-08b4-4bb4-81ce-9785c5d0ba19 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:08.665295 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5c1864ea-5d62-4c15-9e36-b464d7d64424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:08.665756 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5c1864ea-5d62-4c15-9e36-b464d7d64424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:08.666859 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5c1864ea-5d62-4c15-9e36-b464d7d64424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:08.667111 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5c1864ea-5d62-4c15-9e36-b464d7d64424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:09.064659 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5c1864ea-5d62-4c15-9e36-b464d7d64424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:09.069949 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1edfb747-08b4-4bb4-81ce-9785c5d0ba19 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:09.072960 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5c1864ea-5d62-4c15-9e36-b464d7d64424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.419582 Jan 17 21:25:09.082275 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 328/656] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:08 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:09.082461 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1edfb747-08b4-4bb4-81ce-9785c5d0ba19 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.430372 Jan 17 21:25:09.082561 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b7565ac7-091f-4fbf-a05c-824df2cfaa9b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:09.082651 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 329/657] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:08 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:09.082769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b7565ac7-091f-4fbf-a05c-824df2cfaa9b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:09.085227 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b7565ac7-091f-4fbf-a05c-824df2cfaa9b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:09.085695 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b7565ac7-091f-4fbf-a05c-824df2cfaa9b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:09.086757 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b7565ac7-091f-4fbf-a05c-824df2cfaa9b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:09.087207 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b7565ac7-091f-4fbf-a05c-824df2cfaa9b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:09.115388 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b7565ac7-091f-4fbf-a05c-824df2cfaa9b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Going to try to terminate instance {{(pid=116182) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:25:09.191329 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b7565ac7-091f-4fbf-a05c-824df2cfaa9b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "DELETE /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 204 len: 0 microversion: 2.1 time: 0.116355 Jan 17 21:25:09.191853 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 329/658] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:25:09 2022] DELETE /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:25:09.200918 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c106c1c6-db4e-4aba-a011-07a3fcf09444 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:09.201610 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c106c1c6-db4e-4aba-a011-07a3fcf09444 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:09.212193 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c106c1c6-db4e-4aba-a011-07a3fcf09444 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:09.212703 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c106c1c6-db4e-4aba-a011-07a3fcf09444 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:09.213591 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c106c1c6-db4e-4aba-a011-07a3fcf09444 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:09.214033 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c106c1c6-db4e-4aba-a011-07a3fcf09444 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:09.524262 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1c9db492-ea03-4eaf-b4a4-f63a137bfa8f tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:09.524922 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1c9db492-ea03-4eaf-b4a4-f63a137bfa8f tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:09.531531 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c9db492-ea03-4eaf-b4a4-f63a137bfa8f tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:09.531979 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c9db492-ea03-4eaf-b4a4-f63a137bfa8f tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:09.532802 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c9db492-ea03-4eaf-b4a4-f63a137bfa8f tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:09.533239 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c9db492-ea03-4eaf-b4a4-f63a137bfa8f tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:09.814166 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-c106c1c6-db4e-4aba-a011-07a3fcf09444 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:09.822296 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c106c1c6-db4e-4aba-a011-07a3fcf09444 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1515 microversion: 2.1 time: 0.626225 Jan 17 21:25:09.823142 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 330/659] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:09 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1515 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:09.937548 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1c9db492-ea03-4eaf-b4a4-f63a137bfa8f tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:09.945526 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1c9db492-ea03-4eaf-b4a4-f63a137bfa8f tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1318 microversion: 2.1 time: 0.425945 Jan 17 21:25:09.946109 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 330/660] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:09 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:10.090532 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e6c015b0-3930-43f3-b3d9-a42de1733f67 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:10.091063 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-e6c015b0-3930-43f3-b3d9-a42de1733f67 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:10.094345 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-89c01b19-e028-4784-8b8f-75a621e65f12 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:10.094972 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-89c01b19-e028-4784-8b8f-75a621e65f12 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:10.097221 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e6c015b0-3930-43f3-b3d9-a42de1733f67 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:10.097745 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e6c015b0-3930-43f3-b3d9-a42de1733f67 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:10.098550 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e6c015b0-3930-43f3-b3d9-a42de1733f67 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:10.099002 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e6c015b0-3930-43f3-b3d9-a42de1733f67 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:10.101159 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-89c01b19-e028-4784-8b8f-75a621e65f12 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:10.101612 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-89c01b19-e028-4784-8b8f-75a621e65f12 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:10.102416 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-89c01b19-e028-4784-8b8f-75a621e65f12 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:10.102863 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-89c01b19-e028-4784-8b8f-75a621e65f12 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:10.408172 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-89c01b19-e028-4784-8b8f-75a621e65f12 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:10.414325 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-e6c015b0-3930-43f3-b3d9-a42de1733f67 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:10.416718 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-89c01b19-e028-4784-8b8f-75a621e65f12 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.326044 Jan 17 21:25:10.417306 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 331/661] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:10 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:10.422952 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e6c015b0-3930-43f3-b3d9-a42de1733f67 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.336939 Jan 17 21:25:10.423531 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 331/662] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:10 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:10.511239 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-125755b8-9bb7-4172-89b0-b9d2d2f3123b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:10.512701 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-125755b8-9bb7-4172-89b0-b9d2d2f3123b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:10.513799 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-609ac9e8-c6a7-419b-bba9-162fa2f3a95e req-7e2d7061-bafb-4b14-a543-02a6711365fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5edb3c99-d30d-4a2c-8b50-5083b7ea9d96", "tag": "dde4fe76-f1d0-4978-a642-2a35761fdf74"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:10.515362 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:25:10.515362 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:25:10.519922 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-125755b8-9bb7-4172-89b0-b9d2d2f3123b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:10.520405 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-125755b8-9bb7-4172-89b0-b9d2d2f3123b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:10.521441 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-125755b8-9bb7-4172-89b0-b9d2d2f3123b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:10.522032 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-125755b8-9bb7-4172-89b0-b9d2d2f3123b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:10.522625 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-609ac9e8-c6a7-419b-bba9-162fa2f3a95e req-7e2d7061-bafb-4b14-a543-02a6711365fe service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:10.523074 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-609ac9e8-c6a7-419b-bba9-162fa2f3a95e req-7e2d7061-bafb-4b14-a543-02a6711365fe service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:10.534366 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-609ac9e8-c6a7-419b-bba9-162fa2f3a95e req-7e2d7061-bafb-4b14-a543-02a6711365fe service nova] Creating event network-changed:dde4fe76-f1d0-4978-a642-2a35761fdf74 for instance 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 on hv-cinder-82489 Jan 17 21:25:10.539970 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-609ac9e8-c6a7-419b-bba9-162fa2f3a95e req-7e2d7061-bafb-4b14-a543-02a6711365fe service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030085 Jan 17 21:25:10.541151 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 332/663] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:25:10.839671 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b3272b1b-c558-4c0c-a05a-2552f4f446bd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:10.840297 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b3272b1b-c558-4c0c-a05a-2552f4f446bd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:10.846216 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b3272b1b-c558-4c0c-a05a-2552f4f446bd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:10.846665 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b3272b1b-c558-4c0c-a05a-2552f4f446bd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:10.847563 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b3272b1b-c558-4c0c-a05a-2552f4f446bd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:10.848522 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b3272b1b-c558-4c0c-a05a-2552f4f446bd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:10.984392 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b3272b1b-c558-4c0c-a05a-2552f4f446bd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:10.991957 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b3272b1b-c558-4c0c-a05a-2552f4f446bd tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1515 microversion: 2.1 time: 0.156499 Jan 17 21:25:10.992571 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 333/664] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:10 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:10.996879 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7abbeed1-b381-41a0-80ad-a30cfca61308 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:10.997490 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7abbeed1-b381-41a0-80ad-a30cfca61308 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:11.003721 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7abbeed1-b381-41a0-80ad-a30cfca61308 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:11.008638 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7abbeed1-b381-41a0-80ad-a30cfca61308 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:11.008638 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7abbeed1-b381-41a0-80ad-a30cfca61308 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:11.008638 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7abbeed1-b381-41a0-80ad-a30cfca61308 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:11.147054 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7abbeed1-b381-41a0-80ad-a30cfca61308 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:11.155111 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7abbeed1-b381-41a0-80ad-a30cfca61308 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1318 microversion: 2.1 time: 0.161500 Jan 17 21:25:11.155796 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 334/665] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:10 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:11.433383 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a277336c-1ce8-4c9a-bc3b-39a6041244bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:11.435140 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a277336c-1ce8-4c9a-bc3b-39a6041244bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:11.440866 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a277336c-1ce8-4c9a-bc3b-39a6041244bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:11.441913 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a277336c-1ce8-4c9a-bc3b-39a6041244bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:11.442770 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a277336c-1ce8-4c9a-bc3b-39a6041244bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:11.443226 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a277336c-1ce8-4c9a-bc3b-39a6041244bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:11.580751 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-a277336c-1ce8-4c9a-bc3b-39a6041244bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:11.588776 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a277336c-1ce8-4c9a-bc3b-39a6041244bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.159025 Jan 17 21:25:11.589352 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 335/666] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:11 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:11.593653 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2fb9b7f4-439b-412c-b93e-24cc5b80ab1f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:11.594194 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2fb9b7f4-439b-412c-b93e-24cc5b80ab1f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:11.599810 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2fb9b7f4-439b-412c-b93e-24cc5b80ab1f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:11.600263 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2fb9b7f4-439b-412c-b93e-24cc5b80ab1f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:11.601076 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2fb9b7f4-439b-412c-b93e-24cc5b80ab1f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:11.601514 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2fb9b7f4-439b-412c-b93e-24cc5b80ab1f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:11.743077 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2fb9b7f4-439b-412c-b93e-24cc5b80ab1f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:11.750628 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2fb9b7f4-439b-412c-b93e-24cc5b80ab1f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.160320 Jan 17 21:25:11.751182 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 336/667] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:11 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:12.009106 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6a7599f6-d8c1-4984-ba48-ae29b29e6c5e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:12.009724 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6a7599f6-d8c1-4984-ba48-ae29b29e6c5e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:12.015774 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6a7599f6-d8c1-4984-ba48-ae29b29e6c5e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:12.016227 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6a7599f6-d8c1-4984-ba48-ae29b29e6c5e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:12.017040 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6a7599f6-d8c1-4984-ba48-ae29b29e6c5e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:12.017478 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6a7599f6-d8c1-4984-ba48-ae29b29e6c5e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:12.151501 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6a7599f6-d8c1-4984-ba48-ae29b29e6c5e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:12.159109 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6a7599f6-d8c1-4984-ba48-ae29b29e6c5e tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1515 microversion: 2.1 time: 0.153610 Jan 17 21:25:12.159679 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 337/668] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:12 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:12.171835 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-09287918-72d5-4266-b1d7-27e7d9829b20 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:12.172464 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-09287918-72d5-4266-b1d7-27e7d9829b20 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:12.178445 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-09287918-72d5-4266-b1d7-27e7d9829b20 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:12.178898 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-09287918-72d5-4266-b1d7-27e7d9829b20 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:12.179667 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-09287918-72d5-4266-b1d7-27e7d9829b20 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:12.180102 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-09287918-72d5-4266-b1d7-27e7d9829b20 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:12.291974 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-125755b8-9bb7-4172-89b0-b9d2d2f3123b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 14 microversion: 2.20 time: 1.784200 Jan 17 21:25:12.295389 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 332/669] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:10 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 14 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:12.323231 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-09287918-72d5-4266-b1d7-27e7d9829b20 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:12.331958 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-09287918-72d5-4266-b1d7-27e7d9829b20 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1318 microversion: 2.1 time: 0.163432 Jan 17 21:25:12.333135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 338/670] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:12 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:12.605068 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a82bb7f9-d286-4c73-8c09-15197052db92 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:12.605769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a82bb7f9-d286-4c73-8c09-15197052db92 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:12.612665 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a82bb7f9-d286-4c73-8c09-15197052db92 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:12.613120 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a82bb7f9-d286-4c73-8c09-15197052db92 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:12.613904 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a82bb7f9-d286-4c73-8c09-15197052db92 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:12.614349 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a82bb7f9-d286-4c73-8c09-15197052db92 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:12.745423 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a82bb7f9-d286-4c73-8c09-15197052db92 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:12.753266 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a82bb7f9-d286-4c73-8c09-15197052db92 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.152200 Jan 17 21:25:12.754398 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 333/671] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:12 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:12.766646 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b6287ed3-584a-4853-9491-872507e79a75 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:12.767257 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b6287ed3-584a-4853-9491-872507e79a75 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:12.774445 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b6287ed3-584a-4853-9491-872507e79a75 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:12.774902 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b6287ed3-584a-4853-9491-872507e79a75 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:12.775691 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b6287ed3-584a-4853-9491-872507e79a75 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:12.776167 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b6287ed3-584a-4853-9491-872507e79a75 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:13.065130 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b6287ed3-584a-4853-9491-872507e79a75 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:13.072425 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b6287ed3-584a-4853-9491-872507e79a75 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.309350 Jan 17 21:25:13.073089 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 339/672] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:12 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:13.174991 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f3c2a7b4-08e1-4fb6-9313-6232b996234a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:13.175714 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f3c2a7b4-08e1-4fb6-9313-6232b996234a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:13.182062 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f3c2a7b4-08e1-4fb6-9313-6232b996234a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:13.182543 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f3c2a7b4-08e1-4fb6-9313-6232b996234a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:13.183321 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f3c2a7b4-08e1-4fb6-9313-6232b996234a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:13.183768 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f3c2a7b4-08e1-4fb6-9313-6232b996234a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:13.303714 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7e404cde-9cd1-4114-8e52-ab09036621b7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:13.304831 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7e404cde-9cd1-4114-8e52-ab09036621b7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:13.311501 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7e404cde-9cd1-4114-8e52-ab09036621b7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:13.311962 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7e404cde-9cd1-4114-8e52-ab09036621b7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:13.312808 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7e404cde-9cd1-4114-8e52-ab09036621b7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:13.313255 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7e404cde-9cd1-4114-8e52-ab09036621b7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:13.375133 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f3c2a7b4-08e1-4fb6-9313-6232b996234a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:13.383081 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f3c2a7b4-08e1-4fb6-9313-6232b996234a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1515 microversion: 2.1 time: 0.211772 Jan 17 21:25:13.383649 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 334/673] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:13 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:13.387870 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7c21b82e-638d-496f-b064-e78fe80198fd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:13.388473 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7c21b82e-638d-496f-b064-e78fe80198fd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:13.394218 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7c21b82e-638d-496f-b064-e78fe80198fd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:13.394690 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7c21b82e-638d-496f-b064-e78fe80198fd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:13.395483 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7c21b82e-638d-496f-b064-e78fe80198fd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:13.395932 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7c21b82e-638d-496f-b064-e78fe80198fd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:13.524744 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7c21b82e-638d-496f-b064-e78fe80198fd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:13.531903 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7c21b82e-638d-496f-b064-e78fe80198fd tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1506 microversion: 2.1 time: 0.147290 Jan 17 21:25:13.532500 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 335/674] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:13 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:13.548010 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f26e6352-38e1-457c-9a67-5f247bd72126 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0c7497d-5461-4f0f-a75c-80fa582ebb21", "device": "/dev/sdb"}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:13.549612 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f26e6352-38e1-457c-9a67-5f247bd72126 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:13.556219 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f26e6352-38e1-457c-9a67-5f247bd72126 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:13.556706 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f26e6352-38e1-457c-9a67-5f247bd72126 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:13.557489 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f26e6352-38e1-457c-9a67-5f247bd72126 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:13.557932 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f26e6352-38e1-457c-9a67-5f247bd72126 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:14.004795 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7e404cde-9cd1-4114-8e52-ab09036621b7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 14 microversion: 2.20 time: 0.704473 Jan 17 21:25:14.007905 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 340/675] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:13 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 14 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:14.010550 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f2614859-47f8-4e16-88be-1fb921722be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:14.011277 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f2614859-47f8-4e16-88be-1fb921722be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:14.019230 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f2614859-47f8-4e16-88be-1fb921722be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:14.019699 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f2614859-47f8-4e16-88be-1fb921722be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:14.020712 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f2614859-47f8-4e16-88be-1fb921722be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:14.021236 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f2614859-47f8-4e16-88be-1fb921722be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:14.186579 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-f2614859-47f8-4e16-88be-1fb921722be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:14.195422 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f2614859-47f8-4e16-88be-1fb921722be4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.188562 Jan 17 21:25:14.196281 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 341/676] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:14 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:14.200749 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4649909e-4522-4474-9b67-311746c9267c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:14.201356 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4649909e-4522-4474-9b67-311746c9267c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:14.208681 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4649909e-4522-4474-9b67-311746c9267c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:14.208681 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4649909e-4522-4474-9b67-311746c9267c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:14.209436 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4649909e-4522-4474-9b67-311746c9267c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:14.210099 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4649909e-4522-4474-9b67-311746c9267c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:14.227491 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f26e6352-38e1-457c-9a67-5f247bd72126 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "POST /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.682099 Jan 17 21:25:14.228223 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 336/677] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jan 17 21:25:13 2022] POST /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73/os-volume_attachments => generated 194 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:25:14.364041 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4649909e-4522-4474-9b67-311746c9267c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:14.372063 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4649909e-4522-4474-9b67-311746c9267c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.174703 Jan 17 21:25:14.372791 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 342/678] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:14 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:14.400768 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a8d7905d-0369-4f19-a3ef-070efd60aa1d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:14.401500 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a8d7905d-0369-4f19-a3ef-070efd60aa1d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:14.408421 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a8d7905d-0369-4f19-a3ef-070efd60aa1d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:14.408879 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a8d7905d-0369-4f19-a3ef-070efd60aa1d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:14.409722 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a8d7905d-0369-4f19-a3ef-070efd60aa1d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:14.410355 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a8d7905d-0369-4f19-a3ef-070efd60aa1d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:14.540531 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a8d7905d-0369-4f19-a3ef-070efd60aa1d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:14.547781 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a8d7905d-0369-4f19-a3ef-070efd60aa1d tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1515 microversion: 2.1 time: 0.151277 Jan 17 21:25:14.548347 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 337/679] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:14 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:15.015474 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8cc5e5af-0b8f-495b-8a47-04814103c566 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:15.016461 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8cc5e5af-0b8f-495b-8a47-04814103c566 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:15.023362 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8cc5e5af-0b8f-495b-8a47-04814103c566 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:15.023851 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8cc5e5af-0b8f-495b-8a47-04814103c566 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:15.024669 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8cc5e5af-0b8f-495b-8a47-04814103c566 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:15.025115 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8cc5e5af-0b8f-495b-8a47-04814103c566 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:15.189566 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8cc5e5af-0b8f-495b-8a47-04814103c566 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 14 microversion: 2.20 time: 0.177502 Jan 17 21:25:15.190429 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 343/680] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:15 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:15.213394 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b1dc0274-b75c-40dc-88e9-50b32af3b44b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:15.213929 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b1dc0274-b75c-40dc-88e9-50b32af3b44b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:15.220215 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b1dc0274-b75c-40dc-88e9-50b32af3b44b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:15.220730 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b1dc0274-b75c-40dc-88e9-50b32af3b44b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:15.221499 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b1dc0274-b75c-40dc-88e9-50b32af3b44b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:15.221935 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b1dc0274-b75c-40dc-88e9-50b32af3b44b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:15.360096 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b1dc0274-b75c-40dc-88e9-50b32af3b44b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:15.368166 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b1dc0274-b75c-40dc-88e9-50b32af3b44b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.158726 Jan 17 21:25:15.368777 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 338/681] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:15 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:15.389868 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b97153e7-f340-43e7-9f48-251feafe886d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:15.390675 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b97153e7-f340-43e7-9f48-251feafe886d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:15.398072 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b97153e7-f340-43e7-9f48-251feafe886d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:15.398525 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b97153e7-f340-43e7-9f48-251feafe886d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:15.399325 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b97153e7-f340-43e7-9f48-251feafe886d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:15.399760 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b97153e7-f340-43e7-9f48-251feafe886d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:15.540559 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b97153e7-f340-43e7-9f48-251feafe886d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:15.547949 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b97153e7-f340-43e7-9f48-251feafe886d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.162028 Jan 17 21:25:15.548545 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 344/682] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:15 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:15.564221 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-688c8cbf-cdeb-4ecb-a423-95913666fad0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:15.564923 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-688c8cbf-cdeb-4ecb-a423-95913666fad0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:15.570826 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-688c8cbf-cdeb-4ecb-a423-95913666fad0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:15.571285 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-688c8cbf-cdeb-4ecb-a423-95913666fad0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:15.572071 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-688c8cbf-cdeb-4ecb-a423-95913666fad0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:15.572583 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-688c8cbf-cdeb-4ecb-a423-95913666fad0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:15.709559 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-688c8cbf-cdeb-4ecb-a423-95913666fad0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:15.717033 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-688c8cbf-cdeb-4ecb-a423-95913666fad0 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1515 microversion: 2.1 time: 0.156450 Jan 17 21:25:15.717598 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 339/683] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:15 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:16.201247 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c8b5cdc6-9af0-4e6f-8469-c6e6278fff7b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:16.202204 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c8b5cdc6-9af0-4e6f-8469-c6e6278fff7b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:16.208513 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c8b5cdc6-9af0-4e6f-8469-c6e6278fff7b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:16.208982 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c8b5cdc6-9af0-4e6f-8469-c6e6278fff7b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:16.209772 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c8b5cdc6-9af0-4e6f-8469-c6e6278fff7b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:16.210213 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c8b5cdc6-9af0-4e6f-8469-c6e6278fff7b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:16.378303 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c8b5cdc6-9af0-4e6f-8469-c6e6278fff7b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 14 microversion: 2.20 time: 0.180534 Jan 17 21:25:16.379540 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 345/684] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:16 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:16.386845 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fba9cae7-c6b1-4790-ba82-eefc0a83bdb7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:16.387502 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fba9cae7-c6b1-4790-ba82-eefc0a83bdb7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:16.393891 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fba9cae7-c6b1-4790-ba82-eefc0a83bdb7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:16.394355 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fba9cae7-c6b1-4790-ba82-eefc0a83bdb7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:16.395144 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fba9cae7-c6b1-4790-ba82-eefc0a83bdb7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:16.395591 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fba9cae7-c6b1-4790-ba82-eefc0a83bdb7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:16.525971 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-fba9cae7-c6b1-4790-ba82-eefc0a83bdb7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:16.533359 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fba9cae7-c6b1-4790-ba82-eefc0a83bdb7 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.150064 Jan 17 21:25:16.533932 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 340/685] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:16 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:16.565291 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1d5a1936-611a-4acd-ab1c-e9e5339070e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:16.565995 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1d5a1936-611a-4acd-ab1c-e9e5339070e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:16.572910 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1d5a1936-611a-4acd-ab1c-e9e5339070e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:16.573371 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1d5a1936-611a-4acd-ab1c-e9e5339070e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:16.574159 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1d5a1936-611a-4acd-ab1c-e9e5339070e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:16.574597 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1d5a1936-611a-4acd-ab1c-e9e5339070e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:16.714569 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1d5a1936-611a-4acd-ab1c-e9e5339070e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:16.721893 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1d5a1936-611a-4acd-ab1c-e9e5339070e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.160630 Jan 17 21:25:16.722547 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 346/686] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:16 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:16.733704 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d9a7b3e8-0bf3-4032-b5ab-0a0c441f7b1a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:16.734311 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d9a7b3e8-0bf3-4032-b5ab-0a0c441f7b1a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:16.740138 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d9a7b3e8-0bf3-4032-b5ab-0a0c441f7b1a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:16.740619 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d9a7b3e8-0bf3-4032-b5ab-0a0c441f7b1a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:16.741394 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d9a7b3e8-0bf3-4032-b5ab-0a0c441f7b1a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:16.741827 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d9a7b3e8-0bf3-4032-b5ab-0a0c441f7b1a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:16.867740 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d9a7b3e8-0bf3-4032-b5ab-0a0c441f7b1a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:16.874926 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d9a7b3e8-0bf3-4032-b5ab-0a0c441f7b1a tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1515 microversion: 2.1 time: 0.144804 Jan 17 21:25:16.875485 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 341/687] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:16 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1515 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:17.389668 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8124509c-36c6-4b37-b85d-d5216c352582 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:17.390612 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8124509c-36c6-4b37-b85d-d5216c352582 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:17.396963 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8124509c-36c6-4b37-b85d-d5216c352582 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:17.397416 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8124509c-36c6-4b37-b85d-d5216c352582 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:17.398251 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8124509c-36c6-4b37-b85d-d5216c352582 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:17.398723 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8124509c-36c6-4b37-b85d-d5216c352582 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:17.550971 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8a98ca73-3414-40a0-bb98-0dd82b5acda3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:17.551583 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8a98ca73-3414-40a0-bb98-0dd82b5acda3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:17.559316 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8a98ca73-3414-40a0-bb98-0dd82b5acda3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:17.559316 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8a98ca73-3414-40a0-bb98-0dd82b5acda3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:17.560091 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8a98ca73-3414-40a0-bb98-0dd82b5acda3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:17.560966 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8a98ca73-3414-40a0-bb98-0dd82b5acda3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:17.694046 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-8a98ca73-3414-40a0-bb98-0dd82b5acda3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:17.701438 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8a98ca73-3414-40a0-bb98-0dd82b5acda3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.154414 Jan 17 21:25:17.702002 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 342/688] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:17 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:17.738528 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ceea95b8-f3ba-41ff-a39b-a277d2118641 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:17.739209 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ceea95b8-f3ba-41ff-a39b-a277d2118641 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:17.745971 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ceea95b8-f3ba-41ff-a39b-a277d2118641 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:17.746419 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ceea95b8-f3ba-41ff-a39b-a277d2118641 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:17.747199 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ceea95b8-f3ba-41ff-a39b-a277d2118641 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:17.747629 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ceea95b8-f3ba-41ff-a39b-a277d2118641 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:17.882165 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ceea95b8-f3ba-41ff-a39b-a277d2118641 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:17.889493 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ceea95b8-f3ba-41ff-a39b-a277d2118641 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.154617 Jan 17 21:25:17.890068 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 343/689] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:17 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:17.894367 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-887a01e3-5afa-415c-a4c0-0638ce2d87df tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:17.894905 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-887a01e3-5afa-415c-a4c0-0638ce2d87df tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:17.901357 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-887a01e3-5afa-415c-a4c0-0638ce2d87df tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:17.901807 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-887a01e3-5afa-415c-a4c0-0638ce2d87df tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:17.902593 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-887a01e3-5afa-415c-a4c0-0638ce2d87df tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:17.903027 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-887a01e3-5afa-415c-a4c0-0638ce2d87df tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:18.032272 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-887a01e3-5afa-415c-a4c0-0638ce2d87df tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:18.039543 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-887a01e3-5afa-415c-a4c0-0638ce2d87df tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1515 microversion: 2.1 time: 0.148548 Jan 17 21:25:18.040102 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 344/690] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:17 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:18.718042 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6265e379-820b-4a45-b9bd-05d093dd8861 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:18.718561 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6265e379-820b-4a45-b9bd-05d093dd8861 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:18.725276 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6265e379-820b-4a45-b9bd-05d093dd8861 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:18.725728 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6265e379-820b-4a45-b9bd-05d093dd8861 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:18.726498 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6265e379-820b-4a45-b9bd-05d093dd8861 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:18.726934 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6265e379-820b-4a45-b9bd-05d093dd8861 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:18.863977 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6265e379-820b-4a45-b9bd-05d093dd8861 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:18.871842 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6265e379-820b-4a45-b9bd-05d093dd8861 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.157522 Jan 17 21:25:18.872428 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 345/691] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:18 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:18.906273 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-cf2cfb56-34a5-45f8-80e3-31b82b2c7a55 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:18.906866 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-cf2cfb56-34a5-45f8-80e3-31b82b2c7a55 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:18.912780 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cf2cfb56-34a5-45f8-80e3-31b82b2c7a55 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:18.913251 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cf2cfb56-34a5-45f8-80e3-31b82b2c7a55 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:18.914043 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cf2cfb56-34a5-45f8-80e3-31b82b2c7a55 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:18.914489 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cf2cfb56-34a5-45f8-80e3-31b82b2c7a55 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:19.045001 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-cf2cfb56-34a5-45f8-80e3-31b82b2c7a55 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:19.055994 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-cf2cfb56-34a5-45f8-80e3-31b82b2c7a55 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.152920 Jan 17 21:25:19.056692 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 346/692] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:18 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:19.061201 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8cac3183-749f-4ee1-8e6b-5ba9ab680473 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:19.061803 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8cac3183-749f-4ee1-8e6b-5ba9ab680473 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:19.067546 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8cac3183-749f-4ee1-8e6b-5ba9ab680473 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:19.068000 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8cac3183-749f-4ee1-8e6b-5ba9ab680473 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:19.069325 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8cac3183-749f-4ee1-8e6b-5ba9ab680473 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:19.069767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8cac3183-749f-4ee1-8e6b-5ba9ab680473 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:19.198575 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-8cac3183-749f-4ee1-8e6b-5ba9ab680473 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:19.205874 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8cac3183-749f-4ee1-8e6b-5ba9ab680473 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1515 microversion: 2.1 time: 0.148085 Jan 17 21:25:19.206437 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 347/693] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:19 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:19.888132 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-41f8e82f-3eaf-4de7-965a-2bf343b9bfed tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:19.888840 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-41f8e82f-3eaf-4de7-965a-2bf343b9bfed tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:19.895301 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41f8e82f-3eaf-4de7-965a-2bf343b9bfed tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:19.895760 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41f8e82f-3eaf-4de7-965a-2bf343b9bfed tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:19.896628 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41f8e82f-3eaf-4de7-965a-2bf343b9bfed tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:19.897745 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41f8e82f-3eaf-4de7-965a-2bf343b9bfed tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:20.035443 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-41f8e82f-3eaf-4de7-965a-2bf343b9bfed tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:20.043249 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-41f8e82f-3eaf-4de7-965a-2bf343b9bfed tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.158769 Jan 17 21:25:20.043812 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 348/694] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:19 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:20.071863 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-94c3bc89-641c-4dc8-b0cf-e7104525b195 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:20.072506 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-94c3bc89-641c-4dc8-b0cf-e7104525b195 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:20.078352 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-94c3bc89-641c-4dc8-b0cf-e7104525b195 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:20.078808 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-94c3bc89-641c-4dc8-b0cf-e7104525b195 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:20.079592 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-94c3bc89-641c-4dc8-b0cf-e7104525b195 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:20.080036 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-94c3bc89-641c-4dc8-b0cf-e7104525b195 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:20.213194 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-94c3bc89-641c-4dc8-b0cf-e7104525b195 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:20.220810 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-94c3bc89-641c-4dc8-b0cf-e7104525b195 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.152462 Jan 17 21:25:20.221380 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 349/695] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:20 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:20.226600 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1a07658f-e4c2-46ef-8ec7-f82c96bc3802 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:20.227219 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1a07658f-e4c2-46ef-8ec7-f82c96bc3802 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:20.233165 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1a07658f-e4c2-46ef-8ec7-f82c96bc3802 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:20.233655 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1a07658f-e4c2-46ef-8ec7-f82c96bc3802 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:20.234466 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1a07658f-e4c2-46ef-8ec7-f82c96bc3802 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:20.234915 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1a07658f-e4c2-46ef-8ec7-f82c96bc3802 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:20.369522 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1a07658f-e4c2-46ef-8ec7-f82c96bc3802 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:20.376891 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1a07658f-e4c2-46ef-8ec7-f82c96bc3802 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1515 microversion: 2.1 time: 0.154551 Jan 17 21:25:20.377453 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 350/696] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:20 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:21.060296 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-26d987a7-264f-4e1d-aa47-182304bd1703 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:21.060987 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-26d987a7-264f-4e1d-aa47-182304bd1703 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:21.067420 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-26d987a7-264f-4e1d-aa47-182304bd1703 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:21.067878 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-26d987a7-264f-4e1d-aa47-182304bd1703 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:21.068709 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-26d987a7-264f-4e1d-aa47-182304bd1703 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:21.069151 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-26d987a7-264f-4e1d-aa47-182304bd1703 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:21.201403 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-26d987a7-264f-4e1d-aa47-182304bd1703 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:21.208824 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-26d987a7-264f-4e1d-aa47-182304bd1703 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.152224 Jan 17 21:25:21.209888 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 351/697] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:21 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:21.237644 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5a3b5557-f3ef-4223-acee-c8ae978f589f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:21.238168 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5a3b5557-f3ef-4223-acee-c8ae978f589f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:21.243877 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a3b5557-f3ef-4223-acee-c8ae978f589f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:21.244324 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a3b5557-f3ef-4223-acee-c8ae978f589f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:21.245125 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a3b5557-f3ef-4223-acee-c8ae978f589f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:21.245561 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a3b5557-f3ef-4223-acee-c8ae978f589f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:21.346092 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8124509c-36c6-4b37-b85d-d5216c352582 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 14 microversion: 2.20 time: 3.959984 Jan 17 21:25:21.349531 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 347/698] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:17 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 14 bytes in 3962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:21.383193 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5a3b5557-f3ef-4223-acee-c8ae978f589f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:21.390813 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5a3b5557-f3ef-4223-acee-c8ae978f589f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.156647 Jan 17 21:25:21.391366 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 352/699] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:21 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:21.394450 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-90991cf6-dbfb-42d7-afe8-7ece635cea2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:21.395181 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-90991cf6-dbfb-42d7-afe8-7ece635cea2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:21.401989 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-90991cf6-dbfb-42d7-afe8-7ece635cea2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:21.402445 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-90991cf6-dbfb-42d7-afe8-7ece635cea2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:21.403231 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-90991cf6-dbfb-42d7-afe8-7ece635cea2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:21.403674 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-90991cf6-dbfb-42d7-afe8-7ece635cea2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:21.541585 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-90991cf6-dbfb-42d7-afe8-7ece635cea2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:21.549391 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-90991cf6-dbfb-42d7-afe8-7ece635cea2f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1515 microversion: 2.1 time: 0.159002 Jan 17 21:25:21.549962 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 348/700] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:21 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:21.941910 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-c1da3966-8b8b-48d5-93cc-285c6c2c12ea req-e6c4c828-b97e-46c5-9242-afe66bb49c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67bca008-58c3-469e-bda3-bbb2b89fa9be", "name": "network-vif-deleted", "tag": "cedef62e-b83a-4220-b7ba-8ccc29087104"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:21.944698 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:25:21.944698 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:25:21.952938 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-c1da3966-8b8b-48d5-93cc-285c6c2c12ea req-e6c4c828-b97e-46c5-9242-afe66bb49c99 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:21.953389 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-c1da3966-8b8b-48d5-93cc-285c6c2c12ea req-e6c4c828-b97e-46c5-9242-afe66bb49c99 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:21.964542 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-c1da3966-8b8b-48d5-93cc-285c6c2c12ea req-e6c4c828-b97e-46c5-9242-afe66bb49c99 service nova] Creating event network-vif-deleted:cedef62e-b83a-4220-b7ba-8ccc29087104 for instance 67bca008-58c3-469e-bda3-bbb2b89fa9be on hv-cinder-82489 Jan 17 21:25:21.969727 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-c1da3966-8b8b-48d5-93cc-285c6c2c12ea req-e6c4c828-b97e-46c5-9242-afe66bb49c99 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031410 Jan 17 21:25:21.970305 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 353/701] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:25:22.226851 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5e4fd341-52e7-4d6b-9d76-73d0e1fcd603 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:22.227480 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5e4fd341-52e7-4d6b-9d76-73d0e1fcd603 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:22.234056 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5e4fd341-52e7-4d6b-9d76-73d0e1fcd603 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:22.234514 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5e4fd341-52e7-4d6b-9d76-73d0e1fcd603 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:22.235317 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5e4fd341-52e7-4d6b-9d76-73d0e1fcd603 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:22.235763 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5e4fd341-52e7-4d6b-9d76-73d0e1fcd603 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:22.360277 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1d5805ce-7177-4c5c-b73f-bd183c4bdfe9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:22.364727 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1d5805ce-7177-4c5c-b73f-bd183c4bdfe9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:22.380039 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d5805ce-7177-4c5c-b73f-bd183c4bdfe9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:22.381375 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d5805ce-7177-4c5c-b73f-bd183c4bdfe9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:22.382562 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d5805ce-7177-4c5c-b73f-bd183c4bdfe9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:22.383281 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d5805ce-7177-4c5c-b73f-bd183c4bdfe9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:22.426118 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5e4fd341-52e7-4d6b-9d76-73d0e1fcd603 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:22.434255 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5e4fd341-52e7-4d6b-9d76-73d0e1fcd603 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.211743 Jan 17 21:25:22.434847 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 349/702] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:22 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:22.439226 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2d6fc6cc-6303-4e6b-9348-88a6d416cf79 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:22.439989 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2d6fc6cc-6303-4e6b-9348-88a6d416cf79 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:22.446365 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2d6fc6cc-6303-4e6b-9348-88a6d416cf79 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:22.446812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2d6fc6cc-6303-4e6b-9348-88a6d416cf79 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:22.447621 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2d6fc6cc-6303-4e6b-9348-88a6d416cf79 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:22.448074 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2d6fc6cc-6303-4e6b-9348-88a6d416cf79 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:22.513894 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1d5805ce-7177-4c5c-b73f-bd183c4bdfe9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 14 microversion: 2.20 time: 0.159290 Jan 17 21:25:22.517830 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 354/703] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:22 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:22.567380 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8eeb034b-1e45-4fee-a53e-f03eec0d06c3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:22.569216 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8eeb034b-1e45-4fee-a53e-f03eec0d06c3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:22.576115 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8eeb034b-1e45-4fee-a53e-f03eec0d06c3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:22.576939 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8eeb034b-1e45-4fee-a53e-f03eec0d06c3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:22.577997 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8eeb034b-1e45-4fee-a53e-f03eec0d06c3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:22.578829 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8eeb034b-1e45-4fee-a53e-f03eec0d06c3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:22.605348 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2d6fc6cc-6303-4e6b-9348-88a6d416cf79 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:22.613338 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2d6fc6cc-6303-4e6b-9348-88a6d416cf79 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.177442 Jan 17 21:25:22.614809 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 350/704] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:22 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:22.615959 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8eeb034b-1e45-4fee-a53e-f03eec0d06c3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:22.616444 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8eeb034b-1e45-4fee-a53e-f03eec0d06c3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:22.617113 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-8eeb034b-1e45-4fee-a53e-f03eec0d06c3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lazy-loading 'fault' on Instance uuid 67bca008-58c3-469e-bda3-bbb2b89fa9be {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:25:22.672001 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-8eeb034b-1e45-4fee-a53e-f03eec0d06c3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:22.683382 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8eeb034b-1e45-4fee-a53e-f03eec0d06c3 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 200 len: 1308 microversion: 2.1 time: 0.119498 Jan 17 21:25:22.684127 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 355/705] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:22 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:23.451537 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-27bfb6a6-7d4c-45ac-8296-a20eaa2c7b53 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:23.452158 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-27bfb6a6-7d4c-45ac-8296-a20eaa2c7b53 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:23.458676 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-27bfb6a6-7d4c-45ac-8296-a20eaa2c7b53 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:23.460032 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-27bfb6a6-7d4c-45ac-8296-a20eaa2c7b53 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:23.461115 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-27bfb6a6-7d4c-45ac-8296-a20eaa2c7b53 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:23.461966 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-27bfb6a6-7d4c-45ac-8296-a20eaa2c7b53 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:23.525534 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fe5b4ab7-14d4-43b0-b9e2-d756c77a1aaa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:23.526635 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fe5b4ab7-14d4-43b0-b9e2-d756c77a1aaa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:23.532517 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fe5b4ab7-14d4-43b0-b9e2-d756c77a1aaa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:23.532980 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fe5b4ab7-14d4-43b0-b9e2-d756c77a1aaa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:23.533811 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fe5b4ab7-14d4-43b0-b9e2-d756c77a1aaa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:23.534261 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fe5b4ab7-14d4-43b0-b9e2-d756c77a1aaa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:23.614646 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-27bfb6a6-7d4c-45ac-8296-a20eaa2c7b53 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:23.621865 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-27bfb6a6-7d4c-45ac-8296-a20eaa2c7b53 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.174295 Jan 17 21:25:23.622427 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 351/706] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:23 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:23.630089 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8cfd2a8f-0e1f-469d-a988-eb0ed712f334 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:23.630703 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8cfd2a8f-0e1f-469d-a988-eb0ed712f334 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:23.637358 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8cfd2a8f-0e1f-469d-a988-eb0ed712f334 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:23.637815 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8cfd2a8f-0e1f-469d-a988-eb0ed712f334 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:23.638603 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8cfd2a8f-0e1f-469d-a988-eb0ed712f334 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:23.639044 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8cfd2a8f-0e1f-469d-a988-eb0ed712f334 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:23.775161 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8cfd2a8f-0e1f-469d-a988-eb0ed712f334 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:23.782518 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8cfd2a8f-0e1f-469d-a988-eb0ed712f334 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.155926 Jan 17 21:25:23.783076 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 352/707] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:23 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:23.787868 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6d5871b0-8ce9-4374-b1cc-d7f769607dbf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:23.788499 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6d5871b0-8ce9-4374-b1cc-d7f769607dbf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 67bca008-58c3-469e-bda3-bbb2b89fa9be] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:23.794057 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6d5871b0-8ce9-4374-b1cc-d7f769607dbf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:23.794504 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6d5871b0-8ce9-4374-b1cc-d7f769607dbf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:23.795281 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6d5871b0-8ce9-4374-b1cc-d7f769607dbf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:23.795714 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6d5871b0-8ce9-4374-b1cc-d7f769607dbf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:23.809435 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-6d5871b0-8ce9-4374-b1cc-d7f769607dbf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] HTTP exception thrown: Instance 67bca008-58c3-469e-bda3-bbb2b89fa9be could not be found. Jan 17 21:25:23.810016 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6d5871b0-8ce9-4374-b1cc-d7f769607dbf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Returning 404 to user: Instance 67bca008-58c3-469e-bda3-bbb2b89fa9be could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:25:23.810868 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6d5871b0-8ce9-4374-b1cc-d7f769607dbf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be" status: 404 len: 111 microversion: 2.1 time: 0.026875 Jan 17 21:25:23.811393 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 353/708] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:23 2022] GET /compute/v2.1/servers/67bca008-58c3-469e-bda3-bbb2b89fa9be => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:25:24.638941 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-fde41ed9-902d-451c-9435-3312b0680e2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:24.639607 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-fde41ed9-902d-451c-9435-3312b0680e2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:24.645930 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fde41ed9-902d-451c-9435-3312b0680e2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:24.646423 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fde41ed9-902d-451c-9435-3312b0680e2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:24.647765 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fde41ed9-902d-451c-9435-3312b0680e2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:24.648240 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fde41ed9-902d-451c-9435-3312b0680e2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:24.779832 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-fde41ed9-902d-451c-9435-3312b0680e2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:24.787709 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-fde41ed9-902d-451c-9435-3312b0680e2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.151786 Jan 17 21:25:24.788261 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 354/709] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:24 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:24.799469 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-bc3a4b01-9e7e-4d54-b405-eb095d47d36b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:24.800112 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-bc3a4b01-9e7e-4d54-b405-eb095d47d36b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:24.805943 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bc3a4b01-9e7e-4d54-b405-eb095d47d36b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:24.806394 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bc3a4b01-9e7e-4d54-b405-eb095d47d36b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:24.807174 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bc3a4b01-9e7e-4d54-b405-eb095d47d36b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:24.807617 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bc3a4b01-9e7e-4d54-b405-eb095d47d36b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:24.939838 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-bc3a4b01-9e7e-4d54-b405-eb095d47d36b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:24.947638 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-bc3a4b01-9e7e-4d54-b405-eb095d47d36b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.151601 Jan 17 21:25:24.948488 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 355/710] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:24 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:25.808545 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0a9a401c-6294-44d7-9a66-66fdcfdb3770 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:25.809215 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-0a9a401c-6294-44d7-9a66-66fdcfdb3770 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:25.815343 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0a9a401c-6294-44d7-9a66-66fdcfdb3770 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:25.815805 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0a9a401c-6294-44d7-9a66-66fdcfdb3770 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:25.816650 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0a9a401c-6294-44d7-9a66-66fdcfdb3770 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:25.817098 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0a9a401c-6294-44d7-9a66-66fdcfdb3770 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:25.950029 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-0a9a401c-6294-44d7-9a66-66fdcfdb3770 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:25.957508 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-0a9a401c-6294-44d7-9a66-66fdcfdb3770 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.152788 Jan 17 21:25:25.958392 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 356/711] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:25 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:25.966413 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-88288ab5-e25c-4368-a1a9-8018982bac0f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:25.967056 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-88288ab5-e25c-4368-a1a9-8018982bac0f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:25.973355 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-88288ab5-e25c-4368-a1a9-8018982bac0f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:25.973818 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-88288ab5-e25c-4368-a1a9-8018982bac0f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:25.975132 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-88288ab5-e25c-4368-a1a9-8018982bac0f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:25.975571 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-88288ab5-e25c-4368-a1a9-8018982bac0f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:26.110906 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-88288ab5-e25c-4368-a1a9-8018982bac0f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:26.119156 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-88288ab5-e25c-4368-a1a9-8018982bac0f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.158219 Jan 17 21:25:26.119717 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 357/712] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:25 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:26.919521 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fe5b4ab7-14d4-43b0-b9e2-d756c77a1aaa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 18449 microversion: 2.20 time: 3.398133 Jan 17 21:25:26.920760 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 356/713] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:23 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 18449 bytes in 3401 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:25:26.974211 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-76101260-a119-401e-8c13-95578f91a368 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:26.975554 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-76101260-a119-401e-8c13-95578f91a368 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:26.982328 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-76101260-a119-401e-8c13-95578f91a368 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:26.982883 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-76101260-a119-401e-8c13-95578f91a368 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:26.983584 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-76101260-a119-401e-8c13-95578f91a368 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:26.984027 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-76101260-a119-401e-8c13-95578f91a368 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:27.126047 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-76101260-a119-401e-8c13-95578f91a368 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:27.133416 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-76101260-a119-401e-8c13-95578f91a368 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.162877 Jan 17 21:25:27.133983 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 358/714] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:26 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:27.135364 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-030f87d9-a005-45f8-9905-79ccdf0c6625 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:27.136177 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-030f87d9-a005-45f8-9905-79ccdf0c6625 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:27.143141 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-030f87d9-a005-45f8-9905-79ccdf0c6625 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:27.143594 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-030f87d9-a005-45f8-9905-79ccdf0c6625 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:27.144405 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-030f87d9-a005-45f8-9905-79ccdf0c6625 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:27.144851 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-030f87d9-a005-45f8-9905-79ccdf0c6625 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:27.277687 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-030f87d9-a005-45f8-9905-79ccdf0c6625 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:27.284968 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-030f87d9-a005-45f8-9905-79ccdf0c6625 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.153731 Jan 17 21:25:27.285524 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 357/715] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:27 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:27.931789 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2b6c745e-9aca-42fe-9db5-d65db6bd45a1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:27.932732 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2b6c745e-9aca-42fe-9db5-d65db6bd45a1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:27.938953 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2b6c745e-9aca-42fe-9db5-d65db6bd45a1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:27.939408 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2b6c745e-9aca-42fe-9db5-d65db6bd45a1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:27.940225 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2b6c745e-9aca-42fe-9db5-d65db6bd45a1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:27.940703 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2b6c745e-9aca-42fe-9db5-d65db6bd45a1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:28.150500 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4c415038-7a39-4151-8b77-a1a2617cce09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:28.151114 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4c415038-7a39-4151-8b77-a1a2617cce09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:28.157535 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c415038-7a39-4151-8b77-a1a2617cce09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:28.157992 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c415038-7a39-4151-8b77-a1a2617cce09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:28.158788 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c415038-7a39-4151-8b77-a1a2617cce09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:28.159234 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c415038-7a39-4151-8b77-a1a2617cce09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:28.291636 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4c415038-7a39-4151-8b77-a1a2617cce09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:28.299010 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4c415038-7a39-4151-8b77-a1a2617cce09 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.152825 Jan 17 21:25:28.299565 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 358/716] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:28 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:28.304326 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-60f548bd-c840-4f85-a8ad-9d66f0763c09 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:28.304983 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-60f548bd-c840-4f85-a8ad-9d66f0763c09 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:28.310474 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60f548bd-c840-4f85-a8ad-9d66f0763c09 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:28.310933 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60f548bd-c840-4f85-a8ad-9d66f0763c09 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:28.311719 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60f548bd-c840-4f85-a8ad-9d66f0763c09 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:28.312167 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60f548bd-c840-4f85-a8ad-9d66f0763c09 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:28.442590 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-60f548bd-c840-4f85-a8ad-9d66f0763c09 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:28.450291 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-60f548bd-c840-4f85-a8ad-9d66f0763c09 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.149764 Jan 17 21:25:28.450856 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 359/717] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:28 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:28.690818 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2b6c745e-9aca-42fe-9db5-d65db6bd45a1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 22754 microversion: 2.20 time: 0.762991 Jan 17 21:25:28.694513 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 359/718] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:27 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 22754 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:25:29.315702 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fda01c2c-e65c-4fbd-a773-f3e756b6ff59 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:29.316234 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fda01c2c-e65c-4fbd-a773-f3e756b6ff59 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:29.323133 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fda01c2c-e65c-4fbd-a773-f3e756b6ff59 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:29.323584 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fda01c2c-e65c-4fbd-a773-f3e756b6ff59 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:29.324390 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fda01c2c-e65c-4fbd-a773-f3e756b6ff59 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:29.324825 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fda01c2c-e65c-4fbd-a773-f3e756b6ff59 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:29.467771 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4ddc2cb2-f2b2-46ea-b2fd-d21e4aff4e9b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:29.468746 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4ddc2cb2-f2b2-46ea-b2fd-d21e4aff4e9b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:29.471847 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-fda01c2c-e65c-4fbd-a773-f3e756b6ff59 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:29.476267 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4ddc2cb2-f2b2-46ea-b2fd-d21e4aff4e9b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:29.476760 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4ddc2cb2-f2b2-46ea-b2fd-d21e4aff4e9b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:29.477568 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4ddc2cb2-f2b2-46ea-b2fd-d21e4aff4e9b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:29.478016 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4ddc2cb2-f2b2-46ea-b2fd-d21e4aff4e9b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:29.480233 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fda01c2c-e65c-4fbd-a773-f3e756b6ff59 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.168188 Jan 17 21:25:29.491132 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 360/719] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:29 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:29.617358 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4ddc2cb2-f2b2-46ea-b2fd-d21e4aff4e9b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:29.624739 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4ddc2cb2-f2b2-46ea-b2fd-d21e4aff4e9b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.161043 Jan 17 21:25:29.625333 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 360/720] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:29 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:29.702178 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ac578ae0-8e3e-4456-b426-322720581256 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:29.703091 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ac578ae0-8e3e-4456-b426-322720581256 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:29.709073 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac578ae0-8e3e-4456-b426-322720581256 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:29.709532 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac578ae0-8e3e-4456-b426-322720581256 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:29.710318 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac578ae0-8e3e-4456-b426-322720581256 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:29.710757 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac578ae0-8e3e-4456-b426-322720581256 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:29.791967 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ac578ae0-8e3e-4456-b426-322720581256 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 23802 microversion: 2.20 time: 0.093464 Jan 17 21:25:29.792804 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 361/721] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:29 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 23802 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:25:30.497079 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f1fb0a5a-bb6a-43a4-aaa0-c4428c21950a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:30.497601 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f1fb0a5a-bb6a-43a4-aaa0-c4428c21950a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:30.503752 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f1fb0a5a-bb6a-43a4-aaa0-c4428c21950a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:30.504202 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f1fb0a5a-bb6a-43a4-aaa0-c4428c21950a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:30.505009 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f1fb0a5a-bb6a-43a4-aaa0-c4428c21950a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:30.505444 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f1fb0a5a-bb6a-43a4-aaa0-c4428c21950a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:30.634421 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-f1fb0a5a-bb6a-43a4-aaa0-c4428c21950a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:30.641872 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f1fb0a5a-bb6a-43a4-aaa0-c4428c21950a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.148501 Jan 17 21:25:30.642101 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e25d9d28-80e9-499e-8c46-89bf5788cc68 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:30.642672 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 361/722] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:30 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:30.642787 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e25d9d28-80e9-499e-8c46-89bf5788cc68 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:30.650265 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e25d9d28-80e9-499e-8c46-89bf5788cc68 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:30.650720 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e25d9d28-80e9-499e-8c46-89bf5788cc68 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:30.651520 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e25d9d28-80e9-499e-8c46-89bf5788cc68 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:30.651965 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e25d9d28-80e9-499e-8c46-89bf5788cc68 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:30.784009 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-e25d9d28-80e9-499e-8c46-89bf5788cc68 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:30.791858 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e25d9d28-80e9-499e-8c46-89bf5788cc68 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.153788 Jan 17 21:25:30.792438 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 362/723] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:30 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:30.802794 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7b7b74b0-ce81-4ebc-a2d1-784225d3ce14 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:30.803738 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7b7b74b0-ce81-4ebc-a2d1-784225d3ce14 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:30.809895 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7b7b74b0-ce81-4ebc-a2d1-784225d3ce14 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:30.810340 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7b7b74b0-ce81-4ebc-a2d1-784225d3ce14 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:30.811111 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7b7b74b0-ce81-4ebc-a2d1-784225d3ce14 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:30.811541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7b7b74b0-ce81-4ebc-a2d1-784225d3ce14 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:31.658644 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f3565a3c-37c2-4e63-9a29-6ee7360aa190 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:31.659185 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f3565a3c-37c2-4e63-9a29-6ee7360aa190 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:31.666134 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f3565a3c-37c2-4e63-9a29-6ee7360aa190 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:31.666579 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f3565a3c-37c2-4e63-9a29-6ee7360aa190 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:31.667355 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f3565a3c-37c2-4e63-9a29-6ee7360aa190 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:31.667786 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f3565a3c-37c2-4e63-9a29-6ee7360aa190 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:31.801295 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f3565a3c-37c2-4e63-9a29-6ee7360aa190 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:31.809703 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f3565a3c-37c2-4e63-9a29-6ee7360aa190 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.154737 Jan 17 21:25:31.810268 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 363/724] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:31 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:31.814475 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0be70de0-0b32-4125-9e7f-94ac111a13f5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:31.815123 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0be70de0-0b32-4125-9e7f-94ac111a13f5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:31.823898 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0be70de0-0b32-4125-9e7f-94ac111a13f5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:31.824442 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0be70de0-0b32-4125-9e7f-94ac111a13f5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:31.825193 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0be70de0-0b32-4125-9e7f-94ac111a13f5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:31.825645 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0be70de0-0b32-4125-9e7f-94ac111a13f5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:31.973930 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-0be70de0-0b32-4125-9e7f-94ac111a13f5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:31.982006 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0be70de0-0b32-4125-9e7f-94ac111a13f5 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.170698 Jan 17 21:25:31.982792 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 364/725] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:31 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:32.826663 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-538ad974-da19-4609-88c8-723c275bedb2 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:32.827326 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-538ad974-da19-4609-88c8-723c275bedb2 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:32.833506 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-538ad974-da19-4609-88c8-723c275bedb2 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:32.833955 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-538ad974-da19-4609-88c8-723c275bedb2 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:32.834726 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-538ad974-da19-4609-88c8-723c275bedb2 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:32.835160 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-538ad974-da19-4609-88c8-723c275bedb2 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:32.963807 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-538ad974-da19-4609-88c8-723c275bedb2 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:32.971170 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-538ad974-da19-4609-88c8-723c275bedb2 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.148107 Jan 17 21:25:32.971736 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 365/726] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:32 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:32.998420 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-95ce6354-323d-43de-949f-938c576553c9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:32.999038 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-95ce6354-323d-43de-949f-938c576553c9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:33.004848 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-95ce6354-323d-43de-949f-938c576553c9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:33.005313 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-95ce6354-323d-43de-949f-938c576553c9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:33.006095 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-95ce6354-323d-43de-949f-938c576553c9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:33.006539 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-95ce6354-323d-43de-949f-938c576553c9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:33.141366 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-95ce6354-323d-43de-949f-938c576553c9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:33.149176 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-95ce6354-323d-43de-949f-938c576553c9 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.154256 Jan 17 21:25:33.149741 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 366/727] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:32 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:33.988250 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4209be9d-77fc-4a39-a191-584024cf708a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:33.988912 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4209be9d-77fc-4a39-a191-584024cf708a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:33.995262 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4209be9d-77fc-4a39-a191-584024cf708a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:33.995712 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4209be9d-77fc-4a39-a191-584024cf708a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:33.996512 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4209be9d-77fc-4a39-a191-584024cf708a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:33.996953 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4209be9d-77fc-4a39-a191-584024cf708a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:34.141496 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4209be9d-77fc-4a39-a191-584024cf708a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:34.149751 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4209be9d-77fc-4a39-a191-584024cf708a tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.165014 Jan 17 21:25:34.150322 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 367/728] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:33 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:34.165650 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-27c52123-35e9-4cf6-8f07-d3911e8a82fd tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:34.166263 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-27c52123-35e9-4cf6-8f07-d3911e8a82fd tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:34.172316 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-27c52123-35e9-4cf6-8f07-d3911e8a82fd tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:34.172816 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-27c52123-35e9-4cf6-8f07-d3911e8a82fd tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:34.173606 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-27c52123-35e9-4cf6-8f07-d3911e8a82fd tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:34.174051 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-27c52123-35e9-4cf6-8f07-d3911e8a82fd tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:34.305603 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-27c52123-35e9-4cf6-8f07-d3911e8a82fd tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:34.312892 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-27c52123-35e9-4cf6-8f07-d3911e8a82fd tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.150915 Jan 17 21:25:34.313455 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 368/729] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:34 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:34.598361 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7b7b74b0-ce81-4ebc-a2d1-784225d3ce14 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 27625 microversion: 2.20 time: 3.798848 Jan 17 21:25:34.599804 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 362/730] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:30 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 27625 bytes in 3801 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:25:35.166862 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-771b7662-9f17-4941-99bf-bb937d7cc471 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:35.167478 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-771b7662-9f17-4941-99bf-bb937d7cc471 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:35.173941 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-771b7662-9f17-4941-99bf-bb937d7cc471 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:35.174397 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-771b7662-9f17-4941-99bf-bb937d7cc471 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:35.175184 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-771b7662-9f17-4941-99bf-bb937d7cc471 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:35.176125 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-771b7662-9f17-4941-99bf-bb937d7cc471 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:35.311927 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-771b7662-9f17-4941-99bf-bb937d7cc471 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:35.319987 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-771b7662-9f17-4941-99bf-bb937d7cc471 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.156765 Jan 17 21:25:35.320717 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 369/731] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:35 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:35.330206 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-256a6dbc-c35a-4996-8607-a2767d53dc51 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:35.330911 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-256a6dbc-c35a-4996-8607-a2767d53dc51 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:35.338029 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-256a6dbc-c35a-4996-8607-a2767d53dc51 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:35.338487 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-256a6dbc-c35a-4996-8607-a2767d53dc51 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:35.339277 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-256a6dbc-c35a-4996-8607-a2767d53dc51 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:35.339717 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-256a6dbc-c35a-4996-8607-a2767d53dc51 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:35.478078 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-256a6dbc-c35a-4996-8607-a2767d53dc51 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:35.485553 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-256a6dbc-c35a-4996-8607-a2767d53dc51 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.159442 Jan 17 21:25:35.486124 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 363/732] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:35 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:35.610332 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-522e12a5-a830-4238-a9aa-25a95a90da17 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:35.611301 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-522e12a5-a830-4238-a9aa-25a95a90da17 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:35.617859 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-522e12a5-a830-4238-a9aa-25a95a90da17 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:35.618315 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-522e12a5-a830-4238-a9aa-25a95a90da17 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:35.619101 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-522e12a5-a830-4238-a9aa-25a95a90da17 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:35.619541 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-522e12a5-a830-4238-a9aa-25a95a90da17 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:35.710119 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-522e12a5-a830-4238-a9aa-25a95a90da17 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 27861 microversion: 2.20 time: 0.103319 Jan 17 21:25:35.710771 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 370/733] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:35 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 27861 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:25:35.782188 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-755e1d95-8b98-4c41-aa2c-f2dbc597748c req-a4e30f88-e9e6-40ac-8720-9d704b8ed5df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a05a7cb-fb38-46fe-a04b-f8c66845fbd8", "name": "network-vif-plugged", "status": "completed", "tag": "858678d3-306c-4afa-9059-494f90b38571"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:35.783876 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:25:35.783876 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:25:35.791574 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-755e1d95-8b98-4c41-aa2c-f2dbc597748c req-a4e30f88-e9e6-40ac-8720-9d704b8ed5df service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:35.792021 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-755e1d95-8b98-4c41-aa2c-f2dbc597748c req-a4e30f88-e9e6-40ac-8720-9d704b8ed5df service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:35.804037 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-755e1d95-8b98-4c41-aa2c-f2dbc597748c req-a4e30f88-e9e6-40ac-8720-9d704b8ed5df service nova] Creating event network-vif-plugged:858678d3-306c-4afa-9059-494f90b38571 for instance 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 on hv-cinder-82489 Jan 17 21:25:35.808789 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-755e1d95-8b98-4c41-aa2c-f2dbc597748c req-a4e30f88-e9e6-40ac-8720-9d704b8ed5df service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030407 Jan 17 21:25:35.809390 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 364/734] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:25:36.338143 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6e51535d-d727-458e-a04a-218ba77fe34d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:36.338888 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6e51535d-d727-458e-a04a-218ba77fe34d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:36.346111 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6e51535d-d727-458e-a04a-218ba77fe34d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:36.346574 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6e51535d-d727-458e-a04a-218ba77fe34d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:36.347380 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6e51535d-d727-458e-a04a-218ba77fe34d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:36.347823 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6e51535d-d727-458e-a04a-218ba77fe34d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:36.480121 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6c42fa2e-a093-43f5-b6d7-3a6427026882 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:36.480742 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6c42fa2e-a093-43f5-b6d7-3a6427026882 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:36.487095 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6c42fa2e-a093-43f5-b6d7-3a6427026882 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:36.487555 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6c42fa2e-a093-43f5-b6d7-3a6427026882 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:36.488599 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6c42fa2e-a093-43f5-b6d7-3a6427026882 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:36.489020 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6c42fa2e-a093-43f5-b6d7-3a6427026882 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:36.497811 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6e51535d-d727-458e-a04a-218ba77fe34d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:36.505193 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6e51535d-d727-458e-a04a-218ba77fe34d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.172021 Jan 17 21:25:36.505883 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 371/735] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:36 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:36.511109 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-707b6917-ed1b-4485-a921-5131497369e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:36.512543 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-707b6917-ed1b-4485-a921-5131497369e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:36.519662 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-707b6917-ed1b-4485-a921-5131497369e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:36.520204 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-707b6917-ed1b-4485-a921-5131497369e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:36.521185 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-707b6917-ed1b-4485-a921-5131497369e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:36.521706 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-707b6917-ed1b-4485-a921-5131497369e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:36.524234 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6c42fa2e-a093-43f5-b6d7-3a6427026882 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Going to try to terminate instance {{(pid=116183) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:25:36.604761 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6c42fa2e-a093-43f5-b6d7-3a6427026882 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "DELETE /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 204 len: 0 microversion: 2.1 time: 0.129060 Jan 17 21:25:36.605780 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 365/736] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:25:36 2022] DELETE /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:25:36.614660 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-07235fc0-4133-4cdb-98e9-10b067a8769f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:36.616013 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-07235fc0-4133-4cdb-98e9-10b067a8769f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:36.622152 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-07235fc0-4133-4cdb-98e9-10b067a8769f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:36.622541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-07235fc0-4133-4cdb-98e9-10b067a8769f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:36.623342 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-07235fc0-4133-4cdb-98e9-10b067a8769f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:36.623790 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-07235fc0-4133-4cdb-98e9-10b067a8769f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:36.661367 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-707b6917-ed1b-4485-a921-5131497369e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:36.669436 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-707b6917-ed1b-4485-a921-5131497369e1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.162334 Jan 17 21:25:36.669920 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 372/737] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:36 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:36.722765 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d47eed46-c37b-4e43-a572-c4abac37cce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:36.723973 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d47eed46-c37b-4e43-a572-c4abac37cce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:36.730695 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d47eed46-c37b-4e43-a572-c4abac37cce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:36.731159 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d47eed46-c37b-4e43-a572-c4abac37cce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:36.731981 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d47eed46-c37b-4e43-a572-c4abac37cce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:36.732456 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d47eed46-c37b-4e43-a572-c4abac37cce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:36.764631 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-07235fc0-4133-4cdb-98e9-10b067a8769f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:36.772583 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-07235fc0-4133-4cdb-98e9-10b067a8769f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1514 microversion: 2.1 time: 0.162105 Jan 17 21:25:36.773142 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 366/738] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:36 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:36.883792 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d47eed46-c37b-4e43-a572-c4abac37cce7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 27926 microversion: 2.20 time: 0.164481 Jan 17 21:25:36.884461 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 373/739] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:36 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 27926 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:25:37.522622 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-48140083-a773-4d79-a0da-130cdb9b2987 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:37.523223 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-48140083-a773-4d79-a0da-130cdb9b2987 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:37.529659 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-48140083-a773-4d79-a0da-130cdb9b2987 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:37.530106 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-48140083-a773-4d79-a0da-130cdb9b2987 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:37.530887 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-48140083-a773-4d79-a0da-130cdb9b2987 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:37.531426 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-48140083-a773-4d79-a0da-130cdb9b2987 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:37.686719 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-25d30ccc-d7d6-4a74-babd-f48c19cfea98 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:37.687403 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-25d30ccc-d7d6-4a74-babd-f48c19cfea98 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:37.694691 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-25d30ccc-d7d6-4a74-babd-f48c19cfea98 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:37.695151 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-25d30ccc-d7d6-4a74-babd-f48c19cfea98 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:37.695955 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-25d30ccc-d7d6-4a74-babd-f48c19cfea98 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:37.696428 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-25d30ccc-d7d6-4a74-babd-f48c19cfea98 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:37.939532 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-48140083-a773-4d79-a0da-130cdb9b2987 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:37.946782 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-48140083-a773-4d79-a0da-130cdb9b2987 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.428452 Jan 17 21:25:37.947353 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 367/740] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:37 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:37.951585 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-919f3665-828f-4a3f-ab4c-31296413b692 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:37.952193 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-919f3665-828f-4a3f-ab4c-31296413b692 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:37.958593 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-919f3665-828f-4a3f-ab4c-31296413b692 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:37.959060 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-919f3665-828f-4a3f-ab4c-31296413b692 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:37.959863 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-919f3665-828f-4a3f-ab4c-31296413b692 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:37.960537 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-919f3665-828f-4a3f-ab4c-31296413b692 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:37.968545 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-25d30ccc-d7d6-4a74-babd-f48c19cfea98 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:37.977565 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-25d30ccc-d7d6-4a74-babd-f48c19cfea98 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.294659 Jan 17 21:25:37.978250 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 374/741] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:37 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:37.984042 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a2f5377d-1b75-4260-9155-93929a85e2dd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:37.985207 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a2f5377d-1b75-4260-9155-93929a85e2dd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:37.992946 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a2f5377d-1b75-4260-9155-93929a85e2dd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:37.993603 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a2f5377d-1b75-4260-9155-93929a85e2dd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:37.994418 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a2f5377d-1b75-4260-9155-93929a85e2dd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:37.994985 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a2f5377d-1b75-4260-9155-93929a85e2dd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:38.099556 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-919f3665-828f-4a3f-ab4c-31296413b692 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:38.106760 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-919f3665-828f-4a3f-ab4c-31296413b692 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1514 microversion: 2.1 time: 0.158465 Jan 17 21:25:38.107320 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 368/742] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:37 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:38.963139 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ed5d2d6b-1cf6-4390-9bfa-5aec55ca7d72 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:38.963782 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ed5d2d6b-1cf6-4390-9bfa-5aec55ca7d72 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:38.970038 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ed5d2d6b-1cf6-4390-9bfa-5aec55ca7d72 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:38.970482 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ed5d2d6b-1cf6-4390-9bfa-5aec55ca7d72 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:38.971251 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ed5d2d6b-1cf6-4390-9bfa-5aec55ca7d72 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:38.971687 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ed5d2d6b-1cf6-4390-9bfa-5aec55ca7d72 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:39.126621 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ed5d2d6b-1cf6-4390-9bfa-5aec55ca7d72 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:39.135222 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ed5d2d6b-1cf6-4390-9bfa-5aec55ca7d72 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.175942 Jan 17 21:25:39.135801 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 369/743] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:38 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:39.140160 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d040b545-2515-4784-be0f-1f36a9d38f1b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:39.140798 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d040b545-2515-4784-be0f-1f36a9d38f1b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:39.147158 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d040b545-2515-4784-be0f-1f36a9d38f1b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:39.147614 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d040b545-2515-4784-be0f-1f36a9d38f1b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:39.148658 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d040b545-2515-4784-be0f-1f36a9d38f1b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:39.149138 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d040b545-2515-4784-be0f-1f36a9d38f1b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:39.285324 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-d040b545-2515-4784-be0f-1f36a9d38f1b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:39.293425 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d040b545-2515-4784-be0f-1f36a9d38f1b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.156640 Jan 17 21:25:39.294007 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 370/744] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:39 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:39.300836 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b2ca3b57-c9ca-442c-b07f-cdb44f04335b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:39.300836 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b2ca3b57-c9ca-442c-b07f-cdb44f04335b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:39.305524 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b2ca3b57-c9ca-442c-b07f-cdb44f04335b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:39.305985 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b2ca3b57-c9ca-442c-b07f-cdb44f04335b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:39.306795 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b2ca3b57-c9ca-442c-b07f-cdb44f04335b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:39.307355 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b2ca3b57-c9ca-442c-b07f-cdb44f04335b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:39.446373 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b2ca3b57-c9ca-442c-b07f-cdb44f04335b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:39.455387 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b2ca3b57-c9ca-442c-b07f-cdb44f04335b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1514 microversion: 2.1 time: 0.160400 Jan 17 21:25:39.455950 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 371/745] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:39 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:39.460535 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-9af9ef25-fbb3-42b1-b597-bc4950550af8 req-0f668423-795c-47ed-ae46-00d4e7e12810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "851b3dd1-961b-4d23-9594-2a55d4f0f703", "name": "network-vif-plugged", "status": "completed", "tag": "bfd59a07-416c-4292-b1be-059ed60c472c"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:39.462400 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:25:39.462400 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:25:39.469243 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-9af9ef25-fbb3-42b1-b597-bc4950550af8 req-0f668423-795c-47ed-ae46-00d4e7e12810 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:39.469689 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-9af9ef25-fbb3-42b1-b597-bc4950550af8 req-0f668423-795c-47ed-ae46-00d4e7e12810 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:39.481502 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-9af9ef25-fbb3-42b1-b597-bc4950550af8 req-0f668423-795c-47ed-ae46-00d4e7e12810 service nova] Creating event network-vif-plugged:bfd59a07-416c-4292-b1be-059ed60c472c for instance 851b3dd1-961b-4d23-9594-2a55d4f0f703 on hv-cinder-82489 Jan 17 21:25:39.486487 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-9af9ef25-fbb3-42b1-b597-bc4950550af8 req-0f668423-795c-47ed-ae46-00d4e7e12810 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029386 Jan 17 21:25:39.488077 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 372/746] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:25:40.151997 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-318f0122-afed-4898-b913-359a81e4a2e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:40.152886 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-318f0122-afed-4898-b913-359a81e4a2e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:40.159804 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-318f0122-afed-4898-b913-359a81e4a2e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:40.160252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-318f0122-afed-4898-b913-359a81e4a2e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:40.161081 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-318f0122-afed-4898-b913-359a81e4a2e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:40.161514 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-318f0122-afed-4898-b913-359a81e4a2e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:40.299613 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-318f0122-afed-4898-b913-359a81e4a2e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:40.307389 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-318f0122-afed-4898-b913-359a81e4a2e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.159423 Jan 17 21:25:40.307963 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 373/747] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:40 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:40.312248 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-eda061a5-b368-4671-894e-a300d7be921c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:40.312975 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-eda061a5-b368-4671-894e-a300d7be921c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:40.319779 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eda061a5-b368-4671-894e-a300d7be921c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:40.320234 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eda061a5-b368-4671-894e-a300d7be921c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:40.321068 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eda061a5-b368-4671-894e-a300d7be921c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:40.321513 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eda061a5-b368-4671-894e-a300d7be921c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:40.458744 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-eda061a5-b368-4671-894e-a300d7be921c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:40.466299 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-eda061a5-b368-4671-894e-a300d7be921c tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.157362 Jan 17 21:25:40.466947 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 374/748] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:40 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:40.471552 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2115d112-2d25-4028-a754-ea3b2dbca997 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:40.472161 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2115d112-2d25-4028-a754-ea3b2dbca997 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:40.481528 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2115d112-2d25-4028-a754-ea3b2dbca997 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:40.482044 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2115d112-2d25-4028-a754-ea3b2dbca997 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:40.482716 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2115d112-2d25-4028-a754-ea3b2dbca997 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:40.483154 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2115d112-2d25-4028-a754-ea3b2dbca997 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:40.611835 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2115d112-2d25-4028-a754-ea3b2dbca997 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:40.619177 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2115d112-2d25-4028-a754-ea3b2dbca997 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1514 microversion: 2.1 time: 0.150871 Jan 17 21:25:40.619740 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 375/749] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:40 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:41.324558 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-56300fef-0dbb-4638-8881-602a46fd39c1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:41.325169 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-56300fef-0dbb-4638-8881-602a46fd39c1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:41.331372 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-56300fef-0dbb-4638-8881-602a46fd39c1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:41.331828 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-56300fef-0dbb-4638-8881-602a46fd39c1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:41.332645 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-56300fef-0dbb-4638-8881-602a46fd39c1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:41.333091 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-56300fef-0dbb-4638-8881-602a46fd39c1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:41.465300 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-56300fef-0dbb-4638-8881-602a46fd39c1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:41.472730 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-56300fef-0dbb-4638-8881-602a46fd39c1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.151835 Jan 17 21:25:41.473301 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 376/750] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:41 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:41.482324 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-eb7dd1c9-3810-4f5b-a5a0-a2a6eb5f299d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:41.483580 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-eb7dd1c9-3810-4f5b-a5a0-a2a6eb5f299d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:41.489466 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eb7dd1c9-3810-4f5b-a5a0-a2a6eb5f299d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:41.490460 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eb7dd1c9-3810-4f5b-a5a0-a2a6eb5f299d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:41.491278 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eb7dd1c9-3810-4f5b-a5a0-a2a6eb5f299d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:41.491722 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eb7dd1c9-3810-4f5b-a5a0-a2a6eb5f299d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:41.623097 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-eb7dd1c9-3810-4f5b-a5a0-a2a6eb5f299d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:41.630862 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-eb7dd1c9-3810-4f5b-a5a0-a2a6eb5f299d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.151897 Jan 17 21:25:41.631421 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 377/751] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:41 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:41.635738 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-38c4a31c-5782-4c8b-9ef2-9ca872ba390b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:41.636404 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-38c4a31c-5782-4c8b-9ef2-9ca872ba390b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:41.641967 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-38c4a31c-5782-4c8b-9ef2-9ca872ba390b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:41.642425 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-38c4a31c-5782-4c8b-9ef2-9ca872ba390b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:41.643211 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-38c4a31c-5782-4c8b-9ef2-9ca872ba390b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:41.643654 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-38c4a31c-5782-4c8b-9ef2-9ca872ba390b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:41.773684 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-38c4a31c-5782-4c8b-9ef2-9ca872ba390b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:41.780950 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-38c4a31c-5782-4c8b-9ef2-9ca872ba390b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1514 microversion: 2.1 time: 0.148587 Jan 17 21:25:41.781502 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 378/752] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:41 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:41.899910 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a2f5377d-1b75-4260-9155-93929a85e2dd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 27926 microversion: 2.20 time: 3.920116 Jan 17 21:25:41.901044 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 375/753] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:37 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 27926 bytes in 3922 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:25:42.490264 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7fd89afb-33fb-40dd-852e-339de2894ef4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:42.490835 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7fd89afb-33fb-40dd-852e-339de2894ef4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:42.497118 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7fd89afb-33fb-40dd-852e-339de2894ef4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:42.497576 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7fd89afb-33fb-40dd-852e-339de2894ef4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:42.498355 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7fd89afb-33fb-40dd-852e-339de2894ef4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:42.498796 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7fd89afb-33fb-40dd-852e-339de2894ef4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:42.633670 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7fd89afb-33fb-40dd-852e-339de2894ef4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:42.641021 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7fd89afb-33fb-40dd-852e-339de2894ef4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.154488 Jan 17 21:25:42.641588 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 379/754] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:42 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:42.647231 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b43f299f-252c-49ef-9f56-f924f71feb18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:42.647945 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b43f299f-252c-49ef-9f56-f924f71feb18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:42.655384 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b43f299f-252c-49ef-9f56-f924f71feb18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:42.655835 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b43f299f-252c-49ef-9f56-f924f71feb18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:42.656636 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b43f299f-252c-49ef-9f56-f924f71feb18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:42.657080 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b43f299f-252c-49ef-9f56-f924f71feb18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:42.787051 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b43f299f-252c-49ef-9f56-f924f71feb18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:42.795284 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b43f299f-252c-49ef-9f56-f924f71feb18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1259 microversion: 2.1 time: 0.151971 Jan 17 21:25:42.795854 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 376/755] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:42 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:42.798193 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-acec30cc-7161-4bd3-8304-dda42c58dacf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:42.798840 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-acec30cc-7161-4bd3-8304-dda42c58dacf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:42.805796 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-acec30cc-7161-4bd3-8304-dda42c58dacf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:42.806252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-acec30cc-7161-4bd3-8304-dda42c58dacf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:42.807047 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-acec30cc-7161-4bd3-8304-dda42c58dacf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:42.807491 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-acec30cc-7161-4bd3-8304-dda42c58dacf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:42.910925 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0422ba1d-2be8-464c-99b2-cc73005227fa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:42.911875 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0422ba1d-2be8-464c-99b2-cc73005227fa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:42.917800 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0422ba1d-2be8-464c-99b2-cc73005227fa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:42.918249 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0422ba1d-2be8-464c-99b2-cc73005227fa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:42.919039 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0422ba1d-2be8-464c-99b2-cc73005227fa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:42.919471 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0422ba1d-2be8-464c-99b2-cc73005227fa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:42.941079 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-acec30cc-7161-4bd3-8304-dda42c58dacf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:42.949165 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-acec30cc-7161-4bd3-8304-dda42c58dacf tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1514 microversion: 2.1 time: 0.154646 Jan 17 21:25:42.950487 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 380/756] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:42 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:43.181987 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0422ba1d-2be8-464c-99b2-cc73005227fa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 27926 microversion: 2.20 time: 0.274469 Jan 17 21:25:43.182654 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 377/757] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:42 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 27926 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:25:43.657096 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-32753167-9c6d-42cf-94a9-7dbfba55d017 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:43.657707 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-32753167-9c6d-42cf-94a9-7dbfba55d017 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:43.665128 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-32753167-9c6d-42cf-94a9-7dbfba55d017 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:43.665587 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-32753167-9c6d-42cf-94a9-7dbfba55d017 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:43.666391 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-32753167-9c6d-42cf-94a9-7dbfba55d017 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:43.666832 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-32753167-9c6d-42cf-94a9-7dbfba55d017 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:43.818391 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-56ba67dd-bbb2-4820-b740-36ae7bb7df6f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:43.819939 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-56ba67dd-bbb2-4820-b740-36ae7bb7df6f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:43.822092 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-32753167-9c6d-42cf-94a9-7dbfba55d017 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:43.827575 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-56ba67dd-bbb2-4820-b740-36ae7bb7df6f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:43.828063 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-56ba67dd-bbb2-4820-b740-36ae7bb7df6f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:43.828897 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-56ba67dd-bbb2-4820-b740-36ae7bb7df6f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:43.829332 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-56ba67dd-bbb2-4820-b740-36ae7bb7df6f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:43.830805 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-32753167-9c6d-42cf-94a9-7dbfba55d017 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.177354 Jan 17 21:25:43.831874 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 381/758] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:43 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:43.969672 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ae74e5fe-676c-4230-9d92-cddc045e05dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:43.970422 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ae74e5fe-676c-4230-9d92-cddc045e05dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:43.975295 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-56ba67dd-bbb2-4820-b740-36ae7bb7df6f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:43.977628 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ae74e5fe-676c-4230-9d92-cddc045e05dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:43.978147 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ae74e5fe-676c-4230-9d92-cddc045e05dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:43.980572 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ae74e5fe-676c-4230-9d92-cddc045e05dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:43.980572 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ae74e5fe-676c-4230-9d92-cddc045e05dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:43.983818 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-56ba67dd-bbb2-4820-b740-36ae7bb7df6f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1444 microversion: 2.1 time: 0.170699 Jan 17 21:25:43.984962 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 378/759] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:43 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1444 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:44.000547 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-29ac29ca-3646-493a-b081-241268aa3b56 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:44.001386 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-29ac29ca-3646-493a-b081-241268aa3b56 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:44.007462 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-29ac29ca-3646-493a-b081-241268aa3b56 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:44.007908 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-29ac29ca-3646-493a-b081-241268aa3b56 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:44.008905 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-29ac29ca-3646-493a-b081-241268aa3b56 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:44.009423 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-29ac29ca-3646-493a-b081-241268aa3b56 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:44.185205 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ae74e5fe-676c-4230-9d92-cddc045e05dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:44.196065 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ae74e5fe-676c-4230-9d92-cddc045e05dc tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 200 len: 1514 microversion: 2.1 time: 0.231288 Jan 17 21:25:44.202152 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 382/760] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:43 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:44.212226 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-29ac29ca-3646-493a-b081-241268aa3b56 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:44.220103 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-29ac29ca-3646-493a-b081-241268aa3b56 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1444 microversion: 2.1 time: 0.223128 Jan 17 21:25:44.220746 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 379/761] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:43 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1444 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:44.237216 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-08a4921f-f677-4f8c-bbc2-4f71b26255d9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:44.238450 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-08a4921f-f677-4f8c-bbc2-4f71b26255d9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:44.248712 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08a4921f-f677-4f8c-bbc2-4f71b26255d9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:44.249333 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08a4921f-f677-4f8c-bbc2-4f71b26255d9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:44.251385 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08a4921f-f677-4f8c-bbc2-4f71b26255d9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:44.252209 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08a4921f-f677-4f8c-bbc2-4f71b26255d9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:44.326441 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-4edf5ba3-2e21-48ac-886b-dc0ea4e8e103 req-d4f34645-091b-4587-a4ff-5dcd46c1ff51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053a2e02-abf9-46b4-9fbe-a257b05bf3fd", "name": "network-vif-deleted", "tag": "fe07a20a-1b73-4844-9302-39928b39c888"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:44.328185 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:25:44.328185 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:25:44.335251 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-4edf5ba3-2e21-48ac-886b-dc0ea4e8e103 req-d4f34645-091b-4587-a4ff-5dcd46c1ff51 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:44.335824 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-4edf5ba3-2e21-48ac-886b-dc0ea4e8e103 req-d4f34645-091b-4587-a4ff-5dcd46c1ff51 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:44.347931 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-4edf5ba3-2e21-48ac-886b-dc0ea4e8e103 req-d4f34645-091b-4587-a4ff-5dcd46c1ff51 service nova] Creating event network-vif-deleted:fe07a20a-1b73-4844-9302-39928b39c888 for instance 053a2e02-abf9-46b4-9fbe-a257b05bf3fd on hv-cinder-82489 Jan 17 21:25:44.352877 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-4edf5ba3-2e21-48ac-886b-dc0ea4e8e103 req-d4f34645-091b-4587-a4ff-5dcd46c1ff51 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149361 Jan 17 21:25:44.353560 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 383/762] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:25:44.424464 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-08a4921f-f677-4f8c-bbc2-4f71b26255d9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28105 microversion: 2.20 time: 0.192547 Jan 17 21:25:44.425037 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 380/763] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:44 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28105 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:25:44.850376 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0353b2ed-ee4b-4202-92af-c2f315f7a92d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:44.850784 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-0353b2ed-ee4b-4202-92af-c2f315f7a92d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:44.857396 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0353b2ed-ee4b-4202-92af-c2f315f7a92d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:44.857861 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0353b2ed-ee4b-4202-92af-c2f315f7a92d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:44.858668 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0353b2ed-ee4b-4202-92af-c2f315f7a92d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:44.859114 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0353b2ed-ee4b-4202-92af-c2f315f7a92d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:45.036009 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-0353b2ed-ee4b-4202-92af-c2f315f7a92d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:45.045347 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-0353b2ed-ee4b-4202-92af-c2f315f7a92d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1265 microversion: 2.1 time: 0.200924 Jan 17 21:25:45.045808 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 384/764] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:44 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:45.214945 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b594e5b5-0eec-4445-a6df-0d5887920791 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:45.215645 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b594e5b5-0eec-4445-a6df-0d5887920791 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 053a2e02-abf9-46b4-9fbe-a257b05bf3fd] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:45.223713 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b594e5b5-0eec-4445-a6df-0d5887920791 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:45.224990 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b594e5b5-0eec-4445-a6df-0d5887920791 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:45.225566 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b594e5b5-0eec-4445-a6df-0d5887920791 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:45.226119 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b594e5b5-0eec-4445-a6df-0d5887920791 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:45.240939 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-b594e5b5-0eec-4445-a6df-0d5887920791 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] HTTP exception thrown: Instance 053a2e02-abf9-46b4-9fbe-a257b05bf3fd could not be found. Jan 17 21:25:45.241542 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b594e5b5-0eec-4445-a6df-0d5887920791 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Returning 404 to user: Instance 053a2e02-abf9-46b4-9fbe-a257b05bf3fd could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:25:45.242383 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b594e5b5-0eec-4445-a6df-0d5887920791 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd" status: 404 len: 111 microversion: 2.1 time: 0.032255 Jan 17 21:25:45.242959 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 381/765] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:45 2022] GET /compute/v2.1/servers/053a2e02-abf9-46b4-9fbe-a257b05bf3fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 17 21:25:45.250950 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-972ad467-927e-40a4-9413-eb597089428b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:45.251460 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-972ad467-927e-40a4-9413-eb597089428b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:45.258027 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-972ad467-927e-40a4-9413-eb597089428b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:45.258667 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-972ad467-927e-40a4-9413-eb597089428b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:45.259416 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-972ad467-927e-40a4-9413-eb597089428b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:45.259862 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-972ad467-927e-40a4-9413-eb597089428b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:45.285752 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-972ad467-927e-40a4-9413-eb597089428b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Going to try to terminate instance {{(pid=116183) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:25:45.365540 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-972ad467-927e-40a4-9413-eb597089428b tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "DELETE /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 204 len: 0 microversion: 2.1 time: 0.117203 Jan 17 21:25:45.369232 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 385/766] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:25:45 2022] DELETE /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 17 21:25:45.374593 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-63c2420d-cbe8-40bd-94cf-b606a4072617 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:45.375215 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-63c2420d-cbe8-40bd-94cf-b606a4072617 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:45.381587 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63c2420d-cbe8-40bd-94cf-b606a4072617 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:45.382050 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63c2420d-cbe8-40bd-94cf-b606a4072617 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:45.382851 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63c2420d-cbe8-40bd-94cf-b606a4072617 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:45.383308 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63c2420d-cbe8-40bd-94cf-b606a4072617 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:45.437172 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-edb7c5f4-e6dd-4dc4-b6ed-84ff56dc7895 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:45.438358 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-edb7c5f4-e6dd-4dc4-b6ed-84ff56dc7895 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:45.445236 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-edb7c5f4-e6dd-4dc4-b6ed-84ff56dc7895 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:45.445815 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-edb7c5f4-e6dd-4dc4-b6ed-84ff56dc7895 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:45.446804 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-edb7c5f4-e6dd-4dc4-b6ed-84ff56dc7895 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:45.447245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-edb7c5f4-e6dd-4dc4-b6ed-84ff56dc7895 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:45.521582 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-63c2420d-cbe8-40bd-94cf-b606a4072617 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:45.528937 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-63c2420d-cbe8-40bd-94cf-b606a4072617 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1514 microversion: 2.1 time: 0.158128 Jan 17 21:25:45.530203 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 382/767] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:45 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:25:45.540707 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-edb7c5f4-e6dd-4dc4-b6ed-84ff56dc7895 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.107425 Jan 17 21:25:45.541846 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 386/768] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:45 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:25:46.061977 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-687a0ab3-4e9d-430b-8bbe-94406c31c279 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:46.062962 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-687a0ab3-4e9d-430b-8bbe-94406c31c279 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:46.071363 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-687a0ab3-4e9d-430b-8bbe-94406c31c279 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:46.071827 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-687a0ab3-4e9d-430b-8bbe-94406c31c279 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:46.072653 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-687a0ab3-4e9d-430b-8bbe-94406c31c279 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:46.073266 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-687a0ab3-4e9d-430b-8bbe-94406c31c279 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:46.229573 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-687a0ab3-4e9d-430b-8bbe-94406c31c279 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:46.237212 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-687a0ab3-4e9d-430b-8bbe-94406c31c279 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1452 microversion: 2.1 time: 0.178767 Jan 17 21:25:46.241412 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 383/769] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:46 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1452 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:46.255023 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c4caf087-3504-4433-a1df-9fcb0cbd0dbb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:46.255880 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c4caf087-3504-4433-a1df-9fcb0cbd0dbb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:46.264002 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c4caf087-3504-4433-a1df-9fcb0cbd0dbb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:46.264500 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c4caf087-3504-4433-a1df-9fcb0cbd0dbb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:46.265305 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c4caf087-3504-4433-a1df-9fcb0cbd0dbb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:46.265751 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c4caf087-3504-4433-a1df-9fcb0cbd0dbb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:46.436426 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-c4caf087-3504-4433-a1df-9fcb0cbd0dbb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:46.448072 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c4caf087-3504-4433-a1df-9fcb0cbd0dbb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1452 microversion: 2.1 time: 0.196856 Jan 17 21:25:46.449845 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 387/770] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:46 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1452 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:46.547960 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7a44a767-a00d-452f-9250-b59637729787 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:46.548621 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7a44a767-a00d-452f-9250-b59637729787 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:46.553507 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ee4ab33f-e3a1-4880-af4d-c87ae5b6819c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:46.554999 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ee4ab33f-e3a1-4880-af4d-c87ae5b6819c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:46.560850 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7a44a767-a00d-452f-9250-b59637729787 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:46.562700 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7a44a767-a00d-452f-9250-b59637729787 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:46.565167 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7a44a767-a00d-452f-9250-b59637729787 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:46.566955 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7a44a767-a00d-452f-9250-b59637729787 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:46.567549 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ee4ab33f-e3a1-4880-af4d-c87ae5b6819c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:46.568893 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ee4ab33f-e3a1-4880-af4d-c87ae5b6819c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:46.570444 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ee4ab33f-e3a1-4880-af4d-c87ae5b6819c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:46.573557 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ee4ab33f-e3a1-4880-af4d-c87ae5b6819c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:46.668536 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ee4ab33f-e3a1-4880-af4d-c87ae5b6819c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.118798 Jan 17 21:25:46.676598 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 388/771] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:46 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:25:46.726536 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-862c41fd-5a50-4e3f-8418-69e0e38803a5 req-b0ed3370-e10c-46fb-b5ae-21261c20529c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a05a7cb-fb38-46fe-a04b-f8c66845fbd8", "tag": "858678d3-306c-4afa-9059-494f90b38571"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:46.728013 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:25:46.728013 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:25:46.736018 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-862c41fd-5a50-4e3f-8418-69e0e38803a5 req-b0ed3370-e10c-46fb-b5ae-21261c20529c service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:46.736562 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-862c41fd-5a50-4e3f-8418-69e0e38803a5 req-b0ed3370-e10c-46fb-b5ae-21261c20529c service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:46.753604 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-862c41fd-5a50-4e3f-8418-69e0e38803a5 req-b0ed3370-e10c-46fb-b5ae-21261c20529c service nova] Creating event network-changed:858678d3-306c-4afa-9059-494f90b38571 for instance 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 on hv-cinder-82489 Jan 17 21:25:46.760260 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-862c41fd-5a50-4e3f-8418-69e0e38803a5 req-b0ed3370-e10c-46fb-b5ae-21261c20529c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038265 Jan 17 21:25:46.761101 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 389/772] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:25:46.907216 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b2bcf696-2389-463f-bf38-9a4fe59a8ac5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:46.907817 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b2bcf696-2389-463f-bf38-9a4fe59a8ac5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:46.915636 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b2bcf696-2389-463f-bf38-9a4fe59a8ac5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:46.916405 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b2bcf696-2389-463f-bf38-9a4fe59a8ac5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:46.917391 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b2bcf696-2389-463f-bf38-9a4fe59a8ac5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:46.917847 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b2bcf696-2389-463f-bf38-9a4fe59a8ac5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:47.050640 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7a44a767-a00d-452f-9250-b59637729787 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:47.066346 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7a44a767-a00d-452f-9250-b59637729787 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1514 microversion: 2.1 time: 0.522853 Jan 17 21:25:47.070651 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 384/773] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:46 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1514 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:47.071999 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.objects.instance [None req-b2bcf696-2389-463f-bf38-9a4fe59a8ac5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lazy-loading 'services' on Instance uuid d6219615-3cb9-44f4-9bc4-39c53d222a73 {{(pid=116183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:25:47.233950 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b2bcf696-2389-463f-bf38-9a4fe59a8ac5 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73/os-volume_attachments/d0c7497d-5461-4f0f-a75c-80fa582ebb21" status: 202 len: 0 microversion: 2.1 time: 0.330674 Jan 17 21:25:47.234681 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 390/774] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jan 17 21:25:46 2022] DELETE /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73/os-volume_attachments/d0c7497d-5461-4f0f-a75c-80fa582ebb21 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:25:47.684649 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fc5d7b5a-bffc-4607-80e1-618c884c0827 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:47.687123 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fc5d7b5a-bffc-4607-80e1-618c884c0827 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:47.706854 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fc5d7b5a-bffc-4607-80e1-618c884c0827 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:47.707351 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fc5d7b5a-bffc-4607-80e1-618c884c0827 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:47.709160 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fc5d7b5a-bffc-4607-80e1-618c884c0827 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:47.709760 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fc5d7b5a-bffc-4607-80e1-618c884c0827 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:47.787372 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fc5d7b5a-bffc-4607-80e1-618c884c0827 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.107561 Jan 17 21:25:47.788594 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 385/775] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:47 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:25:48.089996 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-631124e5-6e58-4ad7-a885-310dd10050db tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:48.091327 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-631124e5-6e58-4ad7-a885-310dd10050db tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:48.099735 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-631124e5-6e58-4ad7-a885-310dd10050db tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:48.100280 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-631124e5-6e58-4ad7-a885-310dd10050db tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:48.101606 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-631124e5-6e58-4ad7-a885-310dd10050db tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:48.102123 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-631124e5-6e58-4ad7-a885-310dd10050db tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:48.149282 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-631124e5-6e58-4ad7-a885-310dd10050db tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:48.149753 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-631124e5-6e58-4ad7-a885-310dd10050db tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:48.150222 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.objects.instance [None req-631124e5-6e58-4ad7-a885-310dd10050db tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lazy-loading 'fault' on Instance uuid 40eba319-215c-4ff7-be04-20cb0d8d26ee {{(pid=116183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:25:48.215963 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-631124e5-6e58-4ad7-a885-310dd10050db tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:48.224450 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-631124e5-6e58-4ad7-a885-310dd10050db tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 200 len: 1308 microversion: 2.1 time: 0.139638 Jan 17 21:25:48.225026 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 391/776] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:48 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 1308 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:48.378511 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1af79695-5009-4e16-8e97-e6286f0902ba tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:48.379097 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1af79695-5009-4e16-8e97-e6286f0902ba tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:48.386193 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1af79695-5009-4e16-8e97-e6286f0902ba tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:48.386887 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1af79695-5009-4e16-8e97-e6286f0902ba tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:48.387697 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1af79695-5009-4e16-8e97-e6286f0902ba tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:48.388147 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1af79695-5009-4e16-8e97-e6286f0902ba tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:48.415791 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1af79695-5009-4e16-8e97-e6286f0902ba tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Going to try to terminate instance {{(pid=116182) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:25:48.507363 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1af79695-5009-4e16-8e97-e6286f0902ba tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 204 len: 0 microversion: 2.1 time: 0.132657 Jan 17 21:25:48.508303 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 386/777] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:25:48 2022] DELETE /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:25:48.517062 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7fde9cc1-1e20-4aac-bf6f-44d19f56a7e7 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:48.517728 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7fde9cc1-1e20-4aac-bf6f-44d19f56a7e7 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:48.524046 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7fde9cc1-1e20-4aac-bf6f-44d19f56a7e7 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:48.524528 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7fde9cc1-1e20-4aac-bf6f-44d19f56a7e7 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:48.525315 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7fde9cc1-1e20-4aac-bf6f-44d19f56a7e7 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:48.525746 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7fde9cc1-1e20-4aac-bf6f-44d19f56a7e7 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:48.754449 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7fde9cc1-1e20-4aac-bf6f-44d19f56a7e7 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:48.761959 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7fde9cc1-1e20-4aac-bf6f-44d19f56a7e7 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1512 microversion: 2.1 time: 0.249372 Jan 17 21:25:48.762529 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 392/778] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:48 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1512 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:48.780323 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-e532e086-c6c2-4770-a25d-56f8313cb6a6 req-979e4d81-0a44-4bca-be3c-d29455fa8ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40eba319-215c-4ff7-be04-20cb0d8d26ee", "name": "network-vif-deleted", "tag": "687390ab-d9b1-43f0-800b-6bcd99484876"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:48.781873 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:25:48.781873 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:25:48.790495 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-e532e086-c6c2-4770-a25d-56f8313cb6a6 req-979e4d81-0a44-4bca-be3c-d29455fa8ba7 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:48.790950 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-e532e086-c6c2-4770-a25d-56f8313cb6a6 req-979e4d81-0a44-4bca-be3c-d29455fa8ba7 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:48.798416 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-aacc5601-5e1b-4b3c-af2b-c7e9eb729321 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:48.799516 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-aacc5601-5e1b-4b3c-af2b-c7e9eb729321 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:48.801546 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-e532e086-c6c2-4770-a25d-56f8313cb6a6 req-979e4d81-0a44-4bca-be3c-d29455fa8ba7 service nova] Creating event network-vif-deleted:687390ab-d9b1-43f0-800b-6bcd99484876 for instance 40eba319-215c-4ff7-be04-20cb0d8d26ee on hv-cinder-82489 Jan 17 21:25:48.805846 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-aacc5601-5e1b-4b3c-af2b-c7e9eb729321 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:48.806355 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-aacc5601-5e1b-4b3c-af2b-c7e9eb729321 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:48.806500 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-e532e086-c6c2-4770-a25d-56f8313cb6a6 req-979e4d81-0a44-4bca-be3c-d29455fa8ba7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031029 Jan 17 21:25:48.806981 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 387/779] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:25:48.808793 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-aacc5601-5e1b-4b3c-af2b-c7e9eb729321 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:48.809142 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-aacc5601-5e1b-4b3c-af2b-c7e9eb729321 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:48.873462 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-aacc5601-5e1b-4b3c-af2b-c7e9eb729321 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.078460 Jan 17 21:25:48.874138 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 393/780] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:48 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:25:49.219371 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-03325768-9105-457c-8ca2-9319b8a9ce41 req-3bc78fe9-9cdd-4bbd-9df2-bff602db9008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "851b3dd1-961b-4d23-9594-2a55d4f0f703", "tag": "bfd59a07-416c-4292-b1be-059ed60c472c"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:49.220970 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:25:49.220970 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:25:49.228569 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-03325768-9105-457c-8ca2-9319b8a9ce41 req-3bc78fe9-9cdd-4bbd-9df2-bff602db9008 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:49.229015 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-03325768-9105-457c-8ca2-9319b8a9ce41 req-3bc78fe9-9cdd-4bbd-9df2-bff602db9008 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:49.240181 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-03325768-9105-457c-8ca2-9319b8a9ce41 req-3bc78fe9-9cdd-4bbd-9df2-bff602db9008 service nova] Creating event network-changed:bfd59a07-416c-4292-b1be-059ed60c472c for instance 851b3dd1-961b-4d23-9594-2a55d4f0f703 on hv-cinder-82489 Jan 17 21:25:49.242211 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f8313d2a-a446-4f82-bdfd-adf00b2d5a34 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:49.243313 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f8313d2a-a446-4f82-bdfd-adf00b2d5a34 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 40eba319-215c-4ff7-be04-20cb0d8d26ee] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:49.244913 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-03325768-9105-457c-8ca2-9319b8a9ce41 req-3bc78fe9-9cdd-4bbd-9df2-bff602db9008 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212242 Jan 17 21:25:49.245678 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 388/781] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:25:49.253036 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f8313d2a-a446-4f82-bdfd-adf00b2d5a34 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:49.253559 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f8313d2a-a446-4f82-bdfd-adf00b2d5a34 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:49.254359 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f8313d2a-a446-4f82-bdfd-adf00b2d5a34 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:49.254798 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f8313d2a-a446-4f82-bdfd-adf00b2d5a34 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:49.268839 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-f8313d2a-a446-4f82-bdfd-adf00b2d5a34 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] HTTP exception thrown: Instance 40eba319-215c-4ff7-be04-20cb0d8d26ee could not be found. Jan 17 21:25:49.269430 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f8313d2a-a446-4f82-bdfd-adf00b2d5a34 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Returning 404 to user: Instance 40eba319-215c-4ff7-be04-20cb0d8d26ee could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:25:49.270258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f8313d2a-a446-4f82-bdfd-adf00b2d5a34 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee" status: 404 len: 111 microversion: 2.1 time: 0.032711 Jan 17 21:25:49.270842 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 394/782] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:49 2022] GET /compute/v2.1/servers/40eba319-215c-4ff7-be04-20cb0d8d26ee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:25:49.780164 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b95aa9b0-784f-4c9a-891b-98cf9f8235ac tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:49.781275 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b95aa9b0-784f-4c9a-891b-98cf9f8235ac tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:49.789116 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b95aa9b0-784f-4c9a-891b-98cf9f8235ac tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:49.789567 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b95aa9b0-784f-4c9a-891b-98cf9f8235ac tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:49.790473 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b95aa9b0-784f-4c9a-891b-98cf9f8235ac tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:49.790911 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b95aa9b0-784f-4c9a-891b-98cf9f8235ac tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:49.884876 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3ca3c0a8-fcf2-453a-ae10-71541b6b5d48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:49.885793 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3ca3c0a8-fcf2-453a-ae10-71541b6b5d48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:49.892251 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3ca3c0a8-fcf2-453a-ae10-71541b6b5d48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:49.892920 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3ca3c0a8-fcf2-453a-ae10-71541b6b5d48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:49.893719 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3ca3c0a8-fcf2-453a-ae10-71541b6b5d48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:49.894159 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3ca3c0a8-fcf2-453a-ae10-71541b6b5d48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:49.938671 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b95aa9b0-784f-4c9a-891b-98cf9f8235ac tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:49.946648 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b95aa9b0-784f-4c9a-891b-98cf9f8235ac tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1512 microversion: 2.1 time: 0.170773 Jan 17 21:25:49.947224 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 389/783] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:49 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:49.976258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3ca3c0a8-fcf2-453a-ae10-71541b6b5d48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.094996 Jan 17 21:25:49.976995 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 395/784] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:49 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:25:50.409598 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a371bb4e-d7e1-4b44-af4b-2fc8df7ea183 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:50.410102 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a371bb4e-d7e1-4b44-af4b-2fc8df7ea183 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:50.416420 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a371bb4e-d7e1-4b44-af4b-2fc8df7ea183 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:50.416883 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a371bb4e-d7e1-4b44-af4b-2fc8df7ea183 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:50.417673 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a371bb4e-d7e1-4b44-af4b-2fc8df7ea183 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:50.418117 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a371bb4e-d7e1-4b44-af4b-2fc8df7ea183 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:50.443293 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a371bb4e-d7e1-4b44-af4b-2fc8df7ea183 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Going to try to terminate instance {{(pid=116182) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:25:50.521444 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a371bb4e-d7e1-4b44-af4b-2fc8df7ea183 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 204 len: 0 microversion: 2.1 time: 0.115027 Jan 17 21:25:50.522244 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 390/785] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:25:50 2022] DELETE /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:25:50.530814 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1a654526-1165-4870-8f17-dea81c40f5ba tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:50.531510 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1a654526-1165-4870-8f17-dea81c40f5ba tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:50.539351 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1a654526-1165-4870-8f17-dea81c40f5ba tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:50.539808 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1a654526-1165-4870-8f17-dea81c40f5ba tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:50.540696 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1a654526-1165-4870-8f17-dea81c40f5ba tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:50.541171 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1a654526-1165-4870-8f17-dea81c40f5ba tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:50.683607 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1a654526-1165-4870-8f17-dea81c40f5ba tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:50.698625 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1a654526-1165-4870-8f17-dea81c40f5ba tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1513 microversion: 2.1 time: 0.171688 Jan 17 21:25:50.699214 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 396/786] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:50 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:50.969412 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0621d96d-527b-4e8b-99e8-8e79278c938a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:50.970227 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0621d96d-527b-4e8b-99e8-8e79278c938a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:50.977043 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0621d96d-527b-4e8b-99e8-8e79278c938a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:50.977716 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0621d96d-527b-4e8b-99e8-8e79278c938a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:50.978850 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0621d96d-527b-4e8b-99e8-8e79278c938a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:50.979520 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0621d96d-527b-4e8b-99e8-8e79278c938a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:50.989209 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a0f76b5b-d8ef-49db-b2f9-7c4b8b718daf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:50.991443 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a0f76b5b-d8ef-49db-b2f9-7c4b8b718daf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:51.007319 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a0f76b5b-d8ef-49db-b2f9-7c4b8b718daf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:51.007778 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a0f76b5b-d8ef-49db-b2f9-7c4b8b718daf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:51.008665 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a0f76b5b-d8ef-49db-b2f9-7c4b8b718daf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:51.009109 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a0f76b5b-d8ef-49db-b2f9-7c4b8b718daf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:51.059229 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-0621d96d-527b-4e8b-99e8-8e79278c938a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831aba98d11643aab4321dfa499e1d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ac0b68ef1544aa94c22825c7307849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:51.068314 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0621d96d-527b-4e8b-99e8-8e79278c938a tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 200 len: 1470 microversion: 2.1 time: 0.107607 Jan 17 21:25:51.072837 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a0f76b5b-d8ef-49db-b2f9-7c4b8b718daf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.088044 Jan 17 21:25:51.073476 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 397/787] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:50 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:25:51.076505 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 391/788] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:50 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 1470 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:51.078276 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-5e8f0a63-03d4-444f-a92a-b26f728f9cff req-976ae8dd-549d-490c-b178-d858346b80a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6219615-3cb9-44f4-9bc4-39c53d222a73", "name": "network-vif-deleted", "tag": "b2392b89-5cea-4346-bc5a-c8675b50ddc3"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:51.080037 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:25:51.080037 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:25:51.092956 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-5e8f0a63-03d4-444f-a92a-b26f728f9cff req-976ae8dd-549d-490c-b178-d858346b80a7 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:51.093353 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-5e8f0a63-03d4-444f-a92a-b26f728f9cff req-976ae8dd-549d-490c-b178-d858346b80a7 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:51.106169 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-5e8f0a63-03d4-444f-a92a-b26f728f9cff req-976ae8dd-549d-490c-b178-d858346b80a7 service nova] Creating event network-vif-deleted:b2392b89-5cea-4346-bc5a-c8675b50ddc3 for instance d6219615-3cb9-44f4-9bc4-39c53d222a73 on hv-cinder-82489 Jan 17 21:25:51.111223 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-5e8f0a63-03d4-444f-a92a-b26f728f9cff req-976ae8dd-549d-490c-b178-d858346b80a7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036366 Jan 17 21:25:51.111959 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 398/789] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:25:51.716443 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-379bd448-919c-4327-a1dd-e3ae5ab4668f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:51.716982 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-379bd448-919c-4327-a1dd-e3ae5ab4668f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:51.723242 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-379bd448-919c-4327-a1dd-e3ae5ab4668f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:51.724315 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-379bd448-919c-4327-a1dd-e3ae5ab4668f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:51.725140 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-379bd448-919c-4327-a1dd-e3ae5ab4668f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:51.725587 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-379bd448-919c-4327-a1dd-e3ae5ab4668f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:51.864418 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-379bd448-919c-4327-a1dd-e3ae5ab4668f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:51.873597 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-379bd448-919c-4327-a1dd-e3ae5ab4668f tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1513 microversion: 2.1 time: 0.160530 Jan 17 21:25:51.874586 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 392/790] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:51 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:52.087394 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-83637c1e-abfb-45f4-9786-38a2f6870af4 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:52.088098 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-83637c1e-abfb-45f4-9786-38a2f6870af4 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] [instance: d6219615-3cb9-44f4-9bc4-39c53d222a73] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:52.089049 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-50b08b3b-7a7b-43f9-81e5-a0d137b175f8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:52.090095 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-50b08b3b-7a7b-43f9-81e5-a0d137b175f8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:52.095495 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83637c1e-abfb-45f4-9786-38a2f6870af4 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:52.095954 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-50b08b3b-7a7b-43f9-81e5-a0d137b175f8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:52.096089 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83637c1e-abfb-45f4-9786-38a2f6870af4 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:52.096444 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-50b08b3b-7a7b-43f9-81e5-a0d137b175f8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:52.096791 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83637c1e-abfb-45f4-9786-38a2f6870af4 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:52.097238 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83637c1e-abfb-45f4-9786-38a2f6870af4 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:52.097350 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-50b08b3b-7a7b-43f9-81e5-a0d137b175f8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:52.097679 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-50b08b3b-7a7b-43f9-81e5-a0d137b175f8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:52.113893 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-83637c1e-abfb-45f4-9786-38a2f6870af4 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] HTTP exception thrown: Instance d6219615-3cb9-44f4-9bc4-39c53d222a73 could not be found. Jan 17 21:25:52.114510 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-83637c1e-abfb-45f4-9786-38a2f6870af4 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] Returning 404 to user: Instance d6219615-3cb9-44f4-9bc4-39c53d222a73 could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:25:52.115396 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-83637c1e-abfb-45f4-9786-38a2f6870af4 tempest-VolumesSnapshotTestJSON-981415579 tempest-VolumesSnapshotTestJSON-981415579-project] 10.222.0.64 "GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73" status: 404 len: 111 microversion: 2.1 time: 0.033780 Jan 17 21:25:52.115959 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 399/791] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:52 2022] GET /compute/v2.1/servers/d6219615-3cb9-44f4-9bc4-39c53d222a73 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:25:52.185630 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-50b08b3b-7a7b-43f9-81e5-a0d137b175f8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.100281 Jan 17 21:25:52.189547 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 393/792] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:52 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:25:52.890942 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-59393127-907f-4a97-ba7b-c126963ac403 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:52.891580 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-59393127-907f-4a97-ba7b-c126963ac403 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:52.898687 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-59393127-907f-4a97-ba7b-c126963ac403 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:52.899142 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-59393127-907f-4a97-ba7b-c126963ac403 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:52.899928 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-59393127-907f-4a97-ba7b-c126963ac403 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:52.900360 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-59393127-907f-4a97-ba7b-c126963ac403 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:53.034148 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-59393127-907f-4a97-ba7b-c126963ac403 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfa3e62e8f64305a304058e9704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28496391913444ba9a1f04ca404c2c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:25:53.041639 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-59393127-907f-4a97-ba7b-c126963ac403 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 200 len: 1513 microversion: 2.1 time: 0.154479 Jan 17 21:25:53.042236 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 400/793] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:52 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:25:53.173477 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-01a70cde-1f69-4be1-8b51-57fec2f8a355 req-592e3779-421e-4651-9564-cafab470601c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de27f69-552a-4922-8576-4163c4c8bfb0", "name": "network-vif-deleted", "tag": "0371bc2b-703b-41a8-b868-151139132091"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:53.175184 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:25:53.175184 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:25:53.184602 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-01a70cde-1f69-4be1-8b51-57fec2f8a355 req-592e3779-421e-4651-9564-cafab470601c service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:53.185049 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-01a70cde-1f69-4be1-8b51-57fec2f8a355 req-592e3779-421e-4651-9564-cafab470601c service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:53.197659 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8d105480-5fda-4c76-bfa6-044b25c64819 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:53.198590 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8d105480-5fda-4c76-bfa6-044b25c64819 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:53.207590 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-01a70cde-1f69-4be1-8b51-57fec2f8a355 req-592e3779-421e-4651-9564-cafab470601c service nova] Creating event network-vif-deleted:0371bc2b-703b-41a8-b868-151139132091 for instance 3de27f69-552a-4922-8576-4163c4c8bfb0 on hv-cinder-82489 Jan 17 21:25:53.214503 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8d105480-5fda-4c76-bfa6-044b25c64819 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:53.214957 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8d105480-5fda-4c76-bfa6-044b25c64819 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:53.215738 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8d105480-5fda-4c76-bfa6-044b25c64819 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:53.216355 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8d105480-5fda-4c76-bfa6-044b25c64819 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:53.221525 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-01a70cde-1f69-4be1-8b51-57fec2f8a355 req-592e3779-421e-4651-9564-cafab470601c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052082 Jan 17 21:25:53.222120 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 394/794] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:25:53.283177 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8d105480-5fda-4c76-bfa6-044b25c64819 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.089549 Jan 17 21:25:53.287595 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 401/795] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:53 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:25:54.062002 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-776cb49a-db53-401d-9975-177208a80c83 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:25:54.062699 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-776cb49a-db53-401d-9975-177208a80c83 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] [instance: 3de27f69-552a-4922-8576-4163c4c8bfb0] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:54.068994 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-776cb49a-db53-401d-9975-177208a80c83 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:54.069515 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-776cb49a-db53-401d-9975-177208a80c83 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:54.070525 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-776cb49a-db53-401d-9975-177208a80c83 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:54.071329 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-776cb49a-db53-401d-9975-177208a80c83 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:54.087005 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-776cb49a-db53-401d-9975-177208a80c83 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] HTTP exception thrown: Instance 3de27f69-552a-4922-8576-4163c4c8bfb0 could not be found. Jan 17 21:25:54.087510 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-776cb49a-db53-401d-9975-177208a80c83 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] Returning 404 to user: Instance 3de27f69-552a-4922-8576-4163c4c8bfb0 could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:25:54.088327 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-776cb49a-db53-401d-9975-177208a80c83 tempest-AttachVolumeNegativeTest-866880555 tempest-AttachVolumeNegativeTest-866880555-project] 10.222.0.64 "GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0" status: 404 len: 111 microversion: 2.1 time: 0.030843 Jan 17 21:25:54.088893 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 395/796] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:25:54 2022] GET /compute/v2.1/servers/3de27f69-552a-4922-8576-4163c4c8bfb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:25:54.295829 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-10514a01-56c3-4780-b80e-d7808ecbf7db tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:54.296878 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-10514a01-56c3-4780-b80e-d7808ecbf7db tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:54.305247 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-10514a01-56c3-4780-b80e-d7808ecbf7db tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:54.305837 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-10514a01-56c3-4780-b80e-d7808ecbf7db tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:54.306641 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-10514a01-56c3-4780-b80e-d7808ecbf7db tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:54.307080 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-10514a01-56c3-4780-b80e-d7808ecbf7db tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:57.512182 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-10514a01-56c3-4780-b80e-d7808ecbf7db tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 3.220268 Jan 17 21:25:57.516101 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 402/797] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:54 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 3222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:25:58.523600 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c035483b-40fc-4516-9615-690c5c1c8510 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:58.524547 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c035483b-40fc-4516-9615-690c5c1c8510 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:58.530895 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c035483b-40fc-4516-9615-690c5c1c8510 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:58.531341 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c035483b-40fc-4516-9615-690c5c1c8510 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:58.532115 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c035483b-40fc-4516-9615-690c5c1c8510 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:58.532670 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c035483b-40fc-4516-9615-690c5c1c8510 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:58.608306 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c035483b-40fc-4516-9615-690c5c1c8510 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.088296 Jan 17 21:25:58.612150 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 396/798] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:58 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:25:59.620177 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c800957e-d0b9-465a-8eea-daed400f3388 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:25:59.621125 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c800957e-d0b9-465a-8eea-daed400f3388 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:25:59.628671 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c800957e-d0b9-465a-8eea-daed400f3388 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:59.629169 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c800957e-d0b9-465a-8eea-daed400f3388 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:59.629961 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c800957e-d0b9-465a-8eea-daed400f3388 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:25:59.630470 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c800957e-d0b9-465a-8eea-daed400f3388 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:25:59.688776 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c800957e-d0b9-465a-8eea-daed400f3388 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.072543 Jan 17 21:25:59.689723 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 403/799] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:25:59 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:00.701790 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-93400b18-9a47-4d93-afe9-8cae8ddc2088 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:00.703056 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-93400b18-9a47-4d93-afe9-8cae8ddc2088 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:00.710879 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-93400b18-9a47-4d93-afe9-8cae8ddc2088 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:00.711437 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-93400b18-9a47-4d93-afe9-8cae8ddc2088 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:00.712585 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-93400b18-9a47-4d93-afe9-8cae8ddc2088 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:00.713212 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-93400b18-9a47-4d93-afe9-8cae8ddc2088 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:00.791652 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-93400b18-9a47-4d93-afe9-8cae8ddc2088 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.093881 Jan 17 21:26:00.792317 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 397/800] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:00 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:01.803338 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a9862a79-5c0f-4385-948e-c10a6f0f0197 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:01.804447 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a9862a79-5c0f-4385-948e-c10a6f0f0197 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:01.812939 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a9862a79-5c0f-4385-948e-c10a6f0f0197 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:01.813478 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a9862a79-5c0f-4385-948e-c10a6f0f0197 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:01.814291 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a9862a79-5c0f-4385-948e-c10a6f0f0197 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:01.814762 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a9862a79-5c0f-4385-948e-c10a6f0f0197 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:01.889705 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a9862a79-5c0f-4385-948e-c10a6f0f0197 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.089995 Jan 17 21:26:01.890609 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 404/801] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:01 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:02.903502 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-543cbb2a-62b4-459d-aade-eba9cf1f31b3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:02.904588 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-543cbb2a-62b4-459d-aade-eba9cf1f31b3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:02.912399 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-543cbb2a-62b4-459d-aade-eba9cf1f31b3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:02.912866 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-543cbb2a-62b4-459d-aade-eba9cf1f31b3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:02.913658 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-543cbb2a-62b4-459d-aade-eba9cf1f31b3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:02.914090 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-543cbb2a-62b4-459d-aade-eba9cf1f31b3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:02.996727 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-543cbb2a-62b4-459d-aade-eba9cf1f31b3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.097154 Jan 17 21:26:02.997379 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 398/802] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:02 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:04.009774 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4a53eae6-f36a-4609-a8cb-343f8337ae25 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:04.010773 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4a53eae6-f36a-4609-a8cb-343f8337ae25 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:04.017379 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a53eae6-f36a-4609-a8cb-343f8337ae25 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:04.017834 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a53eae6-f36a-4609-a8cb-343f8337ae25 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:04.018632 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a53eae6-f36a-4609-a8cb-343f8337ae25 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:04.019075 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a53eae6-f36a-4609-a8cb-343f8337ae25 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:08.829783 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4a53eae6-f36a-4609-a8cb-343f8337ae25 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 4.824793 Jan 17 21:26:08.830480 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 405/803] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:04 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 4827 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:09.849797 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d347e77b-4735-4c4d-a5a9-e3c5c6558d48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:09.850803 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d347e77b-4735-4c4d-a5a9-e3c5c6558d48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:09.858655 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d347e77b-4735-4c4d-a5a9-e3c5c6558d48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:09.859110 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d347e77b-4735-4c4d-a5a9-e3c5c6558d48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:09.859939 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d347e77b-4735-4c4d-a5a9-e3c5c6558d48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:09.860399 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d347e77b-4735-4c4d-a5a9-e3c5c6558d48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:09.990181 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d347e77b-4735-4c4d-a5a9-e3c5c6558d48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.150795 Jan 17 21:26:09.991359 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 399/804] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:09 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:11.003025 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-96a63ce1-17b9-42dd-a4f4-5ea97d4c5559 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:11.004710 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-96a63ce1-17b9-42dd-a4f4-5ea97d4c5559 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:11.013085 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-96a63ce1-17b9-42dd-a4f4-5ea97d4c5559 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:11.013543 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-96a63ce1-17b9-42dd-a4f4-5ea97d4c5559 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:11.014351 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-96a63ce1-17b9-42dd-a4f4-5ea97d4c5559 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:11.014794 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-96a63ce1-17b9-42dd-a4f4-5ea97d4c5559 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:11.088737 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-96a63ce1-17b9-42dd-a4f4-5ea97d4c5559 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.089760 Jan 17 21:26:11.089391 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 406/805] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:10 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:12.100259 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-08dbbbfc-d947-42a8-8bd8-46381f32718f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:12.101384 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-08dbbbfc-d947-42a8-8bd8-46381f32718f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:12.108395 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08dbbbfc-d947-42a8-8bd8-46381f32718f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:12.108862 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08dbbbfc-d947-42a8-8bd8-46381f32718f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:12.109684 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08dbbbfc-d947-42a8-8bd8-46381f32718f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:12.110129 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-08dbbbfc-d947-42a8-8bd8-46381f32718f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:12.191259 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-08dbbbfc-d947-42a8-8bd8-46381f32718f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.095158 Jan 17 21:26:12.192201 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 400/806] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:12 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:13.204781 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4bf15042-6f63-4d0b-954a-0cfcd9480c97 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:13.205782 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4bf15042-6f63-4d0b-954a-0cfcd9480c97 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:13.213156 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4bf15042-6f63-4d0b-954a-0cfcd9480c97 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:13.213620 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4bf15042-6f63-4d0b-954a-0cfcd9480c97 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:13.214431 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4bf15042-6f63-4d0b-954a-0cfcd9480c97 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:13.214873 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4bf15042-6f63-4d0b-954a-0cfcd9480c97 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:13.293644 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4bf15042-6f63-4d0b-954a-0cfcd9480c97 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.092714 Jan 17 21:26:13.294213 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 407/807] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:13 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:14.306647 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e6c60622-a199-4b17-8e8f-aafc7ebb37be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:14.307669 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e6c60622-a199-4b17-8e8f-aafc7ebb37be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:14.314866 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e6c60622-a199-4b17-8e8f-aafc7ebb37be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:14.315325 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e6c60622-a199-4b17-8e8f-aafc7ebb37be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:14.316123 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e6c60622-a199-4b17-8e8f-aafc7ebb37be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:14.316601 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e6c60622-a199-4b17-8e8f-aafc7ebb37be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:14.381542 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e6c60622-a199-4b17-8e8f-aafc7ebb37be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28222 microversion: 2.20 time: 0.079475 Jan 17 21:26:14.382200 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 401/808] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:14 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:26:15.395152 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-268b954c-5d7a-48d1-bb1d-9eb082658e20 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:15.396748 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-268b954c-5d7a-48d1-bb1d-9eb082658e20 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:15.403535 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-268b954c-5d7a-48d1-bb1d-9eb082658e20 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:15.403980 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-268b954c-5d7a-48d1-bb1d-9eb082658e20 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:15.404792 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-268b954c-5d7a-48d1-bb1d-9eb082658e20 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:15.405226 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-268b954c-5d7a-48d1-bb1d-9eb082658e20 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:15.506079 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-268b954c-5d7a-48d1-bb1d-9eb082658e20 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28254 microversion: 2.20 time: 0.115301 Jan 17 21:26:15.507800 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 408/809] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:15 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28254 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:26:16.518425 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0e99e94f-4fde-4fd9-98da-1a3cef07f835 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:16.519283 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0e99e94f-4fde-4fd9-98da-1a3cef07f835 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:16.526838 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0e99e94f-4fde-4fd9-98da-1a3cef07f835 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:16.527333 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0e99e94f-4fde-4fd9-98da-1a3cef07f835 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:16.528253 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0e99e94f-4fde-4fd9-98da-1a3cef07f835 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:16.528729 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0e99e94f-4fde-4fd9-98da-1a3cef07f835 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:16.622630 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0e99e94f-4fde-4fd9-98da-1a3cef07f835 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28512 microversion: 2.20 time: 0.108275 Jan 17 21:26:16.623295 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 402/810] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:16 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28512 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:17.634596 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-256156f0-cd2f-4d97-9d4a-ba9ded68868d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:17.636228 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-256156f0-cd2f-4d97-9d4a-ba9ded68868d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:17.643143 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-256156f0-cd2f-4d97-9d4a-ba9ded68868d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:17.643578 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-256156f0-cd2f-4d97-9d4a-ba9ded68868d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:17.644388 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-256156f0-cd2f-4d97-9d4a-ba9ded68868d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:17.644833 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-256156f0-cd2f-4d97-9d4a-ba9ded68868d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:17.722833 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-256156f0-cd2f-4d97-9d4a-ba9ded68868d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28584 microversion: 2.20 time: 0.092080 Jan 17 21:26:17.723745 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 409/811] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:17 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28584 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:26:18.734838 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a722b410-e61f-445e-a6ab-3ec87962ec0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:18.735839 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a722b410-e61f-445e-a6ab-3ec87962ec0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:18.742756 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a722b410-e61f-445e-a6ab-3ec87962ec0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:18.743218 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a722b410-e61f-445e-a6ab-3ec87962ec0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:18.744007 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a722b410-e61f-445e-a6ab-3ec87962ec0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:18.744482 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a722b410-e61f-445e-a6ab-3ec87962ec0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:18.821069 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a722b410-e61f-445e-a6ab-3ec87962ec0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.090088 Jan 17 21:26:18.821753 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 403/812] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:18 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:19.832761 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0a4c9323-6ef8-4264-b0c4-ff6cdec9b808 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:19.833803 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-0a4c9323-6ef8-4264-b0c4-ff6cdec9b808 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:19.841633 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0a4c9323-6ef8-4264-b0c4-ff6cdec9b808 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:19.842096 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0a4c9323-6ef8-4264-b0c4-ff6cdec9b808 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:19.842964 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0a4c9323-6ef8-4264-b0c4-ff6cdec9b808 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:19.843409 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0a4c9323-6ef8-4264-b0c4-ff6cdec9b808 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:19.906025 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-0a4c9323-6ef8-4264-b0c4-ff6cdec9b808 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.077052 Jan 17 21:26:19.909999 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 410/813] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:19 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:20.918927 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-681e8da6-95b0-448c-8144-e1cb1c27916f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:20.919924 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-681e8da6-95b0-448c-8144-e1cb1c27916f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:20.927064 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-681e8da6-95b0-448c-8144-e1cb1c27916f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:20.927502 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-681e8da6-95b0-448c-8144-e1cb1c27916f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:20.928284 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-681e8da6-95b0-448c-8144-e1cb1c27916f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:20.928747 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-681e8da6-95b0-448c-8144-e1cb1c27916f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:20.990748 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-681e8da6-95b0-448c-8144-e1cb1c27916f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.076198 Jan 17 21:26:20.991406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 404/814] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:20 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:22.003510 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-375d0cea-6abf-4c63-bcfa-d2ffd8d2f6c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:22.004480 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-375d0cea-6abf-4c63-bcfa-d2ffd8d2f6c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:22.011930 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-375d0cea-6abf-4c63-bcfa-d2ffd8d2f6c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:22.012425 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-375d0cea-6abf-4c63-bcfa-d2ffd8d2f6c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:22.013230 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-375d0cea-6abf-4c63-bcfa-d2ffd8d2f6c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:22.013672 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-375d0cea-6abf-4c63-bcfa-d2ffd8d2f6c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:22.078606 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-375d0cea-6abf-4c63-bcfa-d2ffd8d2f6c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.079076 Jan 17 21:26:22.079545 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 411/815] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:21 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:23.090917 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-273b8242-b9d8-4038-8027-4980d7c47aa6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:23.091912 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-273b8242-b9d8-4038-8027-4980d7c47aa6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:23.098794 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-273b8242-b9d8-4038-8027-4980d7c47aa6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:23.099289 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-273b8242-b9d8-4038-8027-4980d7c47aa6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:23.100094 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-273b8242-b9d8-4038-8027-4980d7c47aa6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:23.100545 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-273b8242-b9d8-4038-8027-4980d7c47aa6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:23.162360 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-273b8242-b9d8-4038-8027-4980d7c47aa6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.075335 Jan 17 21:26:23.163295 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 405/816] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:23 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:24.174409 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7eec7f75-b116-4216-8b75-ec97a59c1f72 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:24.175405 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7eec7f75-b116-4216-8b75-ec97a59c1f72 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:24.182394 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7eec7f75-b116-4216-8b75-ec97a59c1f72 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:24.182850 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7eec7f75-b116-4216-8b75-ec97a59c1f72 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:24.184152 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7eec7f75-b116-4216-8b75-ec97a59c1f72 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:24.184631 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7eec7f75-b116-4216-8b75-ec97a59c1f72 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:24.262560 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7eec7f75-b116-4216-8b75-ec97a59c1f72 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.092009 Jan 17 21:26:24.263192 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 412/817] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:24 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:25.274672 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a4c867f5-fda9-4351-9e3c-51cf6fea5b9d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:25.275567 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a4c867f5-fda9-4351-9e3c-51cf6fea5b9d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:25.283025 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4c867f5-fda9-4351-9e3c-51cf6fea5b9d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:25.283511 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4c867f5-fda9-4351-9e3c-51cf6fea5b9d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:25.284245 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4c867f5-fda9-4351-9e3c-51cf6fea5b9d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:25.284711 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4c867f5-fda9-4351-9e3c-51cf6fea5b9d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:25.345921 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a4c867f5-fda9-4351-9e3c-51cf6fea5b9d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.075232 Jan 17 21:26:25.346579 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 406/818] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:25 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:26.358752 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b111fc58-95f5-4dd4-b81f-2e94a3ffae0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:26.359752 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b111fc58-95f5-4dd4-b81f-2e94a3ffae0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:26.366687 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b111fc58-95f5-4dd4-b81f-2e94a3ffae0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:26.367144 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b111fc58-95f5-4dd4-b81f-2e94a3ffae0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:26.367933 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b111fc58-95f5-4dd4-b81f-2e94a3ffae0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:26.368399 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b111fc58-95f5-4dd4-b81f-2e94a3ffae0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:26.429780 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b111fc58-95f5-4dd4-b81f-2e94a3ffae0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.075529 Jan 17 21:26:26.430718 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 413/819] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:26 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:27.442156 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e35ed6ee-aad1-49f0-a7fa-ae0617520c8d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:27.443156 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e35ed6ee-aad1-49f0-a7fa-ae0617520c8d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:27.450080 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e35ed6ee-aad1-49f0-a7fa-ae0617520c8d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:27.450538 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e35ed6ee-aad1-49f0-a7fa-ae0617520c8d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:27.451333 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e35ed6ee-aad1-49f0-a7fa-ae0617520c8d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:27.451773 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e35ed6ee-aad1-49f0-a7fa-ae0617520c8d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:27.516586 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e35ed6ee-aad1-49f0-a7fa-ae0617520c8d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.078190 Jan 17 21:26:27.517174 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 407/820] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:27 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:28.529084 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-acaf7fae-5572-41cb-9260-b9e753a5387d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:28.530078 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-acaf7fae-5572-41cb-9260-b9e753a5387d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:28.537340 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-acaf7fae-5572-41cb-9260-b9e753a5387d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:28.537821 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-acaf7fae-5572-41cb-9260-b9e753a5387d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:28.538622 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-acaf7fae-5572-41cb-9260-b9e753a5387d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:28.539069 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-acaf7fae-5572-41cb-9260-b9e753a5387d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:28.601751 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-acaf7fae-5572-41cb-9260-b9e753a5387d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.077039 Jan 17 21:26:28.602727 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 414/821] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:28 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:29.614256 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4a7829bc-daf6-45ec-a199-3eea82cd141d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:29.615258 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4a7829bc-daf6-45ec-a199-3eea82cd141d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:29.622175 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4a7829bc-daf6-45ec-a199-3eea82cd141d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:29.622634 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4a7829bc-daf6-45ec-a199-3eea82cd141d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:29.623427 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4a7829bc-daf6-45ec-a199-3eea82cd141d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:29.623874 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4a7829bc-daf6-45ec-a199-3eea82cd141d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:29.689921 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4a7829bc-daf6-45ec-a199-3eea82cd141d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.079543 Jan 17 21:26:29.693898 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 408/822] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:29 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:30.702627 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-011a8a27-d878-4d47-b4ea-da78c0778464 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:30.703616 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-011a8a27-d878-4d47-b4ea-da78c0778464 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:30.710774 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-011a8a27-d878-4d47-b4ea-da78c0778464 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:30.711228 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-011a8a27-d878-4d47-b4ea-da78c0778464 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:30.712011 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-011a8a27-d878-4d47-b4ea-da78c0778464 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:30.712476 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-011a8a27-d878-4d47-b4ea-da78c0778464 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:33.387547 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-011a8a27-d878-4d47-b4ea-da78c0778464 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 2.689308 Jan 17 21:26:33.388289 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 415/823] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:30 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 2691 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:34.398870 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-168b0c17-98e5-4818-87a5-88c33968471a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:34.399870 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-168b0c17-98e5-4818-87a5-88c33968471a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:34.407664 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-168b0c17-98e5-4818-87a5-88c33968471a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:34.408121 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-168b0c17-98e5-4818-87a5-88c33968471a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:34.408941 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-168b0c17-98e5-4818-87a5-88c33968471a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:34.409381 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-168b0c17-98e5-4818-87a5-88c33968471a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:34.468556 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-168b0c17-98e5-4818-87a5-88c33968471a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.073537 Jan 17 21:26:34.469233 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 409/824] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:34 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:35.481666 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c746c477-75d6-45cd-aae0-1d39b775d2dc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:35.482670 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c746c477-75d6-45cd-aae0-1d39b775d2dc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:35.490186 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c746c477-75d6-45cd-aae0-1d39b775d2dc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:35.490647 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c746c477-75d6-45cd-aae0-1d39b775d2dc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:35.491433 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c746c477-75d6-45cd-aae0-1d39b775d2dc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:35.491883 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c746c477-75d6-45cd-aae0-1d39b775d2dc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:35.567312 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c746c477-75d6-45cd-aae0-1d39b775d2dc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.090035 Jan 17 21:26:35.568283 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 416/825] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:35 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:36.580690 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-31f85dc6-10da-48c3-85fd-bf4e091ace16 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:36.581605 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-31f85dc6-10da-48c3-85fd-bf4e091ace16 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:36.588901 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-31f85dc6-10da-48c3-85fd-bf4e091ace16 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:36.589364 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-31f85dc6-10da-48c3-85fd-bf4e091ace16 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:36.590228 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-31f85dc6-10da-48c3-85fd-bf4e091ace16 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:36.590681 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-31f85dc6-10da-48c3-85fd-bf4e091ace16 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:36.652965 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-31f85dc6-10da-48c3-85fd-bf4e091ace16 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.076183 Jan 17 21:26:36.653878 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 410/826] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:36 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:37.665535 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b11d0517-682e-4dbe-9aba-8bc6806bb181 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:37.666539 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b11d0517-682e-4dbe-9aba-8bc6806bb181 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:37.673575 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b11d0517-682e-4dbe-9aba-8bc6806bb181 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:37.674028 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b11d0517-682e-4dbe-9aba-8bc6806bb181 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:37.674825 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b11d0517-682e-4dbe-9aba-8bc6806bb181 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:37.675261 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b11d0517-682e-4dbe-9aba-8bc6806bb181 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:37.735432 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b11d0517-682e-4dbe-9aba-8bc6806bb181 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.073885 Jan 17 21:26:37.736332 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 417/827] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:37 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:38.747769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5644a425-d61a-47b9-9a81-e22f9cd1695a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:38.748863 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5644a425-d61a-47b9-9a81-e22f9cd1695a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:38.756105 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5644a425-d61a-47b9-9a81-e22f9cd1695a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:38.756597 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5644a425-d61a-47b9-9a81-e22f9cd1695a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:38.757416 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5644a425-d61a-47b9-9a81-e22f9cd1695a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:38.757859 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5644a425-d61a-47b9-9a81-e22f9cd1695a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:38.823123 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5644a425-d61a-47b9-9a81-e22f9cd1695a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.079274 Jan 17 21:26:38.823801 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 411/828] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:38 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:39.836580 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-41a2c606-c645-4598-9955-0f908e943530 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:39.837791 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-41a2c606-c645-4598-9955-0f908e943530 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:39.845373 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-41a2c606-c645-4598-9955-0f908e943530 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:39.845834 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-41a2c606-c645-4598-9955-0f908e943530 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:39.846636 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-41a2c606-c645-4598-9955-0f908e943530 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:39.847080 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-41a2c606-c645-4598-9955-0f908e943530 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:39.910967 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-41a2c606-c645-4598-9955-0f908e943530 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.078960 Jan 17 21:26:39.911613 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 418/829] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:39 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:40.926128 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-83ec1b92-6711-430f-8681-ed537edb0ec1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:40.927213 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-83ec1b92-6711-430f-8681-ed537edb0ec1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:40.936168 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-83ec1b92-6711-430f-8681-ed537edb0ec1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:40.936666 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-83ec1b92-6711-430f-8681-ed537edb0ec1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:40.937522 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-83ec1b92-6711-430f-8681-ed537edb0ec1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:40.937976 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-83ec1b92-6711-430f-8681-ed537edb0ec1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:41.005757 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-83ec1b92-6711-430f-8681-ed537edb0ec1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.085711 Jan 17 21:26:41.006751 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 412/830] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:40 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:42.019132 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-04c80f99-316a-46bf-8336-71468546e63b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:42.021502 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-04c80f99-316a-46bf-8336-71468546e63b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:42.030694 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-04c80f99-316a-46bf-8336-71468546e63b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:42.031254 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-04c80f99-316a-46bf-8336-71468546e63b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:42.032157 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-04c80f99-316a-46bf-8336-71468546e63b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:42.032719 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-04c80f99-316a-46bf-8336-71468546e63b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:42.104097 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-04c80f99-316a-46bf-8336-71468546e63b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.089011 Jan 17 21:26:42.104898 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 419/831] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:42 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:43.115806 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2a802d2e-c722-484a-8770-92090dbfae16 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:43.117027 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2a802d2e-c722-484a-8770-92090dbfae16 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:43.125386 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2a802d2e-c722-484a-8770-92090dbfae16 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:43.125831 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2a802d2e-c722-484a-8770-92090dbfae16 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:43.126833 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2a802d2e-c722-484a-8770-92090dbfae16 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:43.127275 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2a802d2e-c722-484a-8770-92090dbfae16 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:43.220434 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2a802d2e-c722-484a-8770-92090dbfae16 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.107395 Jan 17 21:26:43.223025 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 413/832] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:43 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:44.234480 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-562e7135-f892-408d-9235-e60294acc442 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:44.235498 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-562e7135-f892-408d-9235-e60294acc442 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:44.242262 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-562e7135-f892-408d-9235-e60294acc442 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:44.242719 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-562e7135-f892-408d-9235-e60294acc442 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:44.243513 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-562e7135-f892-408d-9235-e60294acc442 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:44.244178 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-562e7135-f892-408d-9235-e60294acc442 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:44.321484 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-562e7135-f892-408d-9235-e60294acc442 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.091045 Jan 17 21:26:44.323626 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 420/833] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:44 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:45.335441 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d9b11f2c-e130-47a1-afcf-9f2a75d3b5a3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:45.336814 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d9b11f2c-e130-47a1-afcf-9f2a75d3b5a3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:45.343912 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d9b11f2c-e130-47a1-afcf-9f2a75d3b5a3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:45.344674 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d9b11f2c-e130-47a1-afcf-9f2a75d3b5a3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:45.345469 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d9b11f2c-e130-47a1-afcf-9f2a75d3b5a3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:45.346061 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d9b11f2c-e130-47a1-afcf-9f2a75d3b5a3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:45.425930 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d9b11f2c-e130-47a1-afcf-9f2a75d3b5a3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.095127 Jan 17 21:26:45.427041 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 414/834] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:45 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:46.443005 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-24006515-2668-43c1-944c-a44437253dda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:46.447548 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-24006515-2668-43c1-944c-a44437253dda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:46.466967 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24006515-2668-43c1-944c-a44437253dda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:46.469963 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24006515-2668-43c1-944c-a44437253dda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:46.474374 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24006515-2668-43c1-944c-a44437253dda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:46.475276 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24006515-2668-43c1-944c-a44437253dda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:46.563843 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-24006515-2668-43c1-944c-a44437253dda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.128740 Jan 17 21:26:46.564531 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 421/835] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:46 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:47.577549 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-15f64adf-3ce7-41f4-a9a0-9c543fcdb36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:47.579340 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-15f64adf-3ce7-41f4-a9a0-9c543fcdb36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:47.588802 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-15f64adf-3ce7-41f4-a9a0-9c543fcdb36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:47.589236 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-15f64adf-3ce7-41f4-a9a0-9c543fcdb36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:47.590052 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-15f64adf-3ce7-41f4-a9a0-9c543fcdb36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:47.590500 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-15f64adf-3ce7-41f4-a9a0-9c543fcdb36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:47.669054 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-15f64adf-3ce7-41f4-a9a0-9c543fcdb36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.095968 Jan 17 21:26:47.670881 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 415/836] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:47 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:48.682283 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-fd5421c6-0da4-45be-ba82-fba647a05f3f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:48.686903 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-fd5421c6-0da4-45be-ba82-fba647a05f3f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:48.697093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fd5421c6-0da4-45be-ba82-fba647a05f3f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:48.697937 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fd5421c6-0da4-45be-ba82-fba647a05f3f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:48.698784 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fd5421c6-0da4-45be-ba82-fba647a05f3f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:48.699779 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fd5421c6-0da4-45be-ba82-fba647a05f3f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:48.782794 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-fd5421c6-0da4-45be-ba82-fba647a05f3f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.104619 Jan 17 21:26:48.783378 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 422/837] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:48 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:49.796277 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2340e639-1c68-4b47-a805-8e4afa5d61b5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:49.798176 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2340e639-1c68-4b47-a805-8e4afa5d61b5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:49.804941 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2340e639-1c68-4b47-a805-8e4afa5d61b5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:49.805529 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2340e639-1c68-4b47-a805-8e4afa5d61b5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:49.806463 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2340e639-1c68-4b47-a805-8e4afa5d61b5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:49.806994 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2340e639-1c68-4b47-a805-8e4afa5d61b5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:49.881031 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2340e639-1c68-4b47-a805-8e4afa5d61b5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.089243 Jan 17 21:26:49.882392 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 416/838] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:49 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:50.893577 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-55d9be32-9c7e-4b2d-b157-0e4934604055 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:50.894598 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-55d9be32-9c7e-4b2d-b157-0e4934604055 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:50.906266 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-55d9be32-9c7e-4b2d-b157-0e4934604055 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:50.906730 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-55d9be32-9c7e-4b2d-b157-0e4934604055 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:50.907702 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-55d9be32-9c7e-4b2d-b157-0e4934604055 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:50.908320 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-55d9be32-9c7e-4b2d-b157-0e4934604055 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:50.986717 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-55d9be32-9c7e-4b2d-b157-0e4934604055 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.096824 Jan 17 21:26:50.988001 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 423/839] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:50 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:52.000406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1bb077ce-30cf-4f69-816a-caadbd7bb3a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:52.001715 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1bb077ce-30cf-4f69-816a-caadbd7bb3a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:52.012872 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1bb077ce-30cf-4f69-816a-caadbd7bb3a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:52.013867 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1bb077ce-30cf-4f69-816a-caadbd7bb3a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:52.015022 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1bb077ce-30cf-4f69-816a-caadbd7bb3a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:52.015785 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1bb077ce-30cf-4f69-816a-caadbd7bb3a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:52.088119 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1bb077ce-30cf-4f69-816a-caadbd7bb3a6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.092381 Jan 17 21:26:52.088895 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 417/840] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:51 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:53.102455 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c9555e7e-6b6f-45d7-a1b8-e7fb71828cea tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:53.103376 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c9555e7e-6b6f-45d7-a1b8-e7fb71828cea tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:53.113235 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c9555e7e-6b6f-45d7-a1b8-e7fb71828cea tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:53.114022 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c9555e7e-6b6f-45d7-a1b8-e7fb71828cea tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:53.115044 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c9555e7e-6b6f-45d7-a1b8-e7fb71828cea tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:53.115640 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c9555e7e-6b6f-45d7-a1b8-e7fb71828cea tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:53.196518 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c9555e7e-6b6f-45d7-a1b8-e7fb71828cea tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.098349 Jan 17 21:26:53.197813 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 424/841] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:53 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:26:54.209656 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5837be73-75d2-4d0d-ad99-240be24948c3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:54.210929 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5837be73-75d2-4d0d-ad99-240be24948c3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:54.218783 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5837be73-75d2-4d0d-ad99-240be24948c3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:54.219517 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5837be73-75d2-4d0d-ad99-240be24948c3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:54.220520 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5837be73-75d2-4d0d-ad99-240be24948c3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:54.221119 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5837be73-75d2-4d0d-ad99-240be24948c3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:54.294781 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5837be73-75d2-4d0d-ad99-240be24948c3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.089431 Jan 17 21:26:54.299419 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 418/842] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:54 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:55.314459 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6a1a0249-1ff6-4e76-895e-18ee67ea1d40 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:55.315458 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6a1a0249-1ff6-4e76-895e-18ee67ea1d40 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:55.325017 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6a1a0249-1ff6-4e76-895e-18ee67ea1d40 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:55.325837 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6a1a0249-1ff6-4e76-895e-18ee67ea1d40 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:55.326854 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6a1a0249-1ff6-4e76-895e-18ee67ea1d40 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:55.327501 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6a1a0249-1ff6-4e76-895e-18ee67ea1d40 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:55.411064 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6a1a0249-1ff6-4e76-895e-18ee67ea1d40 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.100409 Jan 17 21:26:55.412114 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 425/843] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:55 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:26:56.433756 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e55f5951-c10b-4c75-8e8c-f16bf05a0d3b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:56.434819 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e55f5951-c10b-4c75-8e8c-f16bf05a0d3b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:56.454322 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e55f5951-c10b-4c75-8e8c-f16bf05a0d3b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:56.454781 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e55f5951-c10b-4c75-8e8c-f16bf05a0d3b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:56.455591 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e55f5951-c10b-4c75-8e8c-f16bf05a0d3b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:56.456040 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e55f5951-c10b-4c75-8e8c-f16bf05a0d3b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:56.522491 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e55f5951-c10b-4c75-8e8c-f16bf05a0d3b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.101845 Jan 17 21:26:56.523799 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 419/844] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:56 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:57.536267 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9c6eb1ce-8e14-4846-8294-ad4e9cab9386 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:57.537455 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-9c6eb1ce-8e14-4846-8294-ad4e9cab9386 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:57.548764 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9c6eb1ce-8e14-4846-8294-ad4e9cab9386 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:57.549219 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9c6eb1ce-8e14-4846-8294-ad4e9cab9386 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:57.550264 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9c6eb1ce-8e14-4846-8294-ad4e9cab9386 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:57.550917 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9c6eb1ce-8e14-4846-8294-ad4e9cab9386 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:57.617470 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-9c6eb1ce-8e14-4846-8294-ad4e9cab9386 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.085687 Jan 17 21:26:57.618437 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 426/845] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:57 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:58.633578 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1909286f-3a48-44bf-8f80-bcafcef27d7c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:58.635413 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1909286f-3a48-44bf-8f80-bcafcef27d7c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:58.644002 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1909286f-3a48-44bf-8f80-bcafcef27d7c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:58.645761 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1909286f-3a48-44bf-8f80-bcafcef27d7c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:58.647052 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1909286f-3a48-44bf-8f80-bcafcef27d7c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:58.647518 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1909286f-3a48-44bf-8f80-bcafcef27d7c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:58.720264 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1909286f-3a48-44bf-8f80-bcafcef27d7c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.093465 Jan 17 21:26:58.722463 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 420/846] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:58 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:26:59.547966 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-21dea4e3-7272-4e59-a5b2-6c7547dff887 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Action: 'create', calling method: .version_select at 0x7f897b367dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-725386759"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:59.563882 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-21dea4e3-7272-4e59-a5b2-6c7547dff887 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Getting quotas for project 33682ba1d2ed4a519d30f654b5d9b876. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:26:59.568310 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-21dea4e3-7272-4e59-a5b2-6c7547dff887 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Getting quotas for user febaa74bf52c40069395b85df46767f7 and project 33682ba1d2ed4a519d30f654b5d9b876. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:26:59.583912 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: ERROR oslo.messaging._drivers.impl_rabbit [None req-21dea4e3-7272-4e59-a5b2-6c7547dff887 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [24339259-f51c-4926-9321-9d786a9f9e9c] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 17 21:26:59.732938 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f9c13400-31d9-4d0e-8902-02fc32ef99e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:26:59.734058 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f9c13400-31d9-4d0e-8902-02fc32ef99e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:26:59.741159 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f9c13400-31d9-4d0e-8902-02fc32ef99e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:59.741607 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f9c13400-31d9-4d0e-8902-02fc32ef99e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:59.742385 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f9c13400-31d9-4d0e-8902-02fc32ef99e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:26:59.743088 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f9c13400-31d9-4d0e-8902-02fc32ef99e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:26:59.810738 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f9c13400-31d9-4d0e-8902-02fc32ef99e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.082760 Jan 17 21:26:59.811343 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 421/847] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:26:59 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:27:00.592273 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO oslo.messaging._drivers.impl_rabbit [None req-21dea4e3-7272-4e59-a5b2-6c7547dff887 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [24339259-f51c-4926-9321-9d786a9f9e9c] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 51202. Jan 17 21:27:00.823038 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-bce6ee7f-b13e-404f-ab52-deca90801518 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:00.824675 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-bce6ee7f-b13e-404f-ab52-deca90801518 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:00.831579 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bce6ee7f-b13e-404f-ab52-deca90801518 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:00.832029 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bce6ee7f-b13e-404f-ab52-deca90801518 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:00.832847 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bce6ee7f-b13e-404f-ab52-deca90801518 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:00.833285 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bce6ee7f-b13e-404f-ab52-deca90801518 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:00.896771 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-bce6ee7f-b13e-404f-ab52-deca90801518 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 28680 microversion: 2.20 time: 0.077635 Jan 17 21:27:00.897408 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 422/848] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:27:00 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 28680 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:27:01.198839 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-21dea4e3-7272-4e59-a5b2-6c7547dff887 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Getting quotas for project 33682ba1d2ed4a519d30f654b5d9b876. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:27:01.202798 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-21dea4e3-7272-4e59-a5b2-6c7547dff887 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Getting quotas for user febaa74bf52c40069395b85df46767f7 and project 33682ba1d2ed4a519d30f654b5d9b876. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:27:01.216437 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-21dea4e3-7272-4e59-a5b2-6c7547dff887 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 1.672668 Jan 17 21:27:01.217039 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 427/849] 10.222.0.64 () {60 vars in 1157 bytes} [Mon Jan 17 21:26:59 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:27:01.265356 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1743058579", "imageRef": "4d8f40e3-0859-43ee-8be0-dd7140be84c7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-725386759", "networks": [{"uuid": "cc4abef7-e15d-4b61-841c-c9c636857baa"}]}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:01.317718 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.network.neutron [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] validate_networks() for [('cc4abef7-e15d-4b61-841c-c9c636857baa', None, None, None, None, None)] {{(pid=116182) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:27:01.810378 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Flavor limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:27:01.810801 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Image limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:27:01.811277 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Flavor pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:27:01.811708 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Image pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:27:01.812091 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:27:01.821009 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:01.821461 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:01.822274 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:01.822711 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:01.840145 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Getting quotas for project 33682ba1d2ed4a519d30f654b5d9b876. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:27:01.844089 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Getting quotas for user febaa74bf52c40069395b85df46767f7 and project 33682ba1d2ed4a519d30f654b5d9b876. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:27:01.855776 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Going to run 1 instances... {{(pid=116182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:27:01.858204 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4d8f40e3-0859-43ee-8be0-dd7140be84c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:27:01.907047 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-765c2640-b934-401a-b954-b6d77479e718 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645824 Jan 17 21:27:01.907695 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 423/850] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:27:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:27:01.909211 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-bdb53d2d-93c2-4b55-8749-18cf8ee83530 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:01.910401 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-bdb53d2d-93c2-4b55-8749-18cf8ee83530 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:01.918056 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a2e6d780-ec08-4dc9-b5aa-8a1ac1170a1b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:01.918424 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bdb53d2d-93c2-4b55-8749-18cf8ee83530 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:01.918673 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a2e6d780-ec08-4dc9-b5aa-8a1ac1170a1b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:01.918865 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bdb53d2d-93c2-4b55-8749-18cf8ee83530 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:01.919675 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bdb53d2d-93c2-4b55-8749-18cf8ee83530 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:01.920337 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bdb53d2d-93c2-4b55-8749-18cf8ee83530 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:01.976302 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a2e6d780-ec08-4dc9-b5aa-8a1ac1170a1b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:01.983289 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a2e6d780-ec08-4dc9-b5aa-8a1ac1170a1b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1258 microversion: 2.1 time: 0.069738 Jan 17 21:27:01.984129 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 424/851] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:01 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:27:02.003742 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-bdb53d2d-93c2-4b55-8749-18cf8ee83530 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 29162 microversion: 2.20 time: 0.098679 Jan 17 21:27:02.004425 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 428/852] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:27:01 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 29162 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:27:03.000691 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f7a75001-26c4-439b-8059-ab66afbee3a7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:03.001917 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f7a75001-26c4-439b-8059-ab66afbee3a7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:03.010648 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f7a75001-26c4-439b-8059-ab66afbee3a7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:03.011205 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f7a75001-26c4-439b-8059-ab66afbee3a7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:03.012083 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f7a75001-26c4-439b-8059-ab66afbee3a7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:03.012915 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f7a75001-26c4-439b-8059-ab66afbee3a7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:03.016147 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d3688a9f-98e6-44af-b385-6c970684bfac tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:03.017189 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d3688a9f-98e6-44af-b385-6c970684bfac tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:03.025955 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3688a9f-98e6-44af-b385-6c970684bfac tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:03.026457 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3688a9f-98e6-44af-b385-6c970684bfac tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:03.027539 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3688a9f-98e6-44af-b385-6c970684bfac tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:03.028246 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3688a9f-98e6-44af-b385-6c970684bfac tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:03.097838 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f7a75001-26c4-439b-8059-ab66afbee3a7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:03.106151 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f7a75001-26c4-439b-8059-ab66afbee3a7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1310 microversion: 2.1 time: 0.109046 Jan 17 21:27:03.106748 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 425/853] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:02 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1310 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:27:03.121603 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d3688a9f-98e6-44af-b385-6c970684bfac tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 31107 microversion: 2.20 time: 0.109434 Jan 17 21:27:03.122259 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 429/854] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:27:03 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 31107 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:27:04.127093 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-03e688ce-464b-4c41-8488-128ddeca71df tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:04.128388 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-03e688ce-464b-4c41-8488-128ddeca71df tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:04.138993 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-559d0dc5-0680-4138-9a84-55b840cbc733 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:04.141872 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03e688ce-464b-4c41-8488-128ddeca71df tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:04.141872 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03e688ce-464b-4c41-8488-128ddeca71df tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:04.141872 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03e688ce-464b-4c41-8488-128ddeca71df tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:04.141872 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03e688ce-464b-4c41-8488-128ddeca71df tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:04.145517 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-559d0dc5-0680-4138-9a84-55b840cbc733 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:04.159703 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-559d0dc5-0680-4138-9a84-55b840cbc733 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:04.161196 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-559d0dc5-0680-4138-9a84-55b840cbc733 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:04.162647 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-559d0dc5-0680-4138-9a84-55b840cbc733 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:04.163459 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-559d0dc5-0680-4138-9a84-55b840cbc733 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:04.301054 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-03e688ce-464b-4c41-8488-128ddeca71df tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:04.309057 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-03e688ce-464b-4c41-8488-128ddeca71df tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.189235 Jan 17 21:27:04.310639 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 426/855] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:04 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:27:05.331747 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ccb52fc8-2b7c-4f96-8ff1-b059318fd217 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:05.332897 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ccb52fc8-2b7c-4f96-8ff1-b059318fd217 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:05.345053 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ccb52fc8-2b7c-4f96-8ff1-b059318fd217 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:05.345859 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ccb52fc8-2b7c-4f96-8ff1-b059318fd217 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:05.347342 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ccb52fc8-2b7c-4f96-8ff1-b059318fd217 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:05.348001 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ccb52fc8-2b7c-4f96-8ff1-b059318fd217 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:05.539444 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ccb52fc8-2b7c-4f96-8ff1-b059318fd217 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:05.547439 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ccb52fc8-2b7c-4f96-8ff1-b059318fd217 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.222581 Jan 17 21:27:05.548021 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 427/856] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:05 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:27:06.565529 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f3cdf03a-3d32-4f8e-99f7-326cd8377c7c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:06.566245 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f3cdf03a-3d32-4f8e-99f7-326cd8377c7c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:06.572529 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f3cdf03a-3d32-4f8e-99f7-326cd8377c7c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:06.572992 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f3cdf03a-3d32-4f8e-99f7-326cd8377c7c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:06.574297 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f3cdf03a-3d32-4f8e-99f7-326cd8377c7c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:06.574743 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f3cdf03a-3d32-4f8e-99f7-326cd8377c7c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:06.710069 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f3cdf03a-3d32-4f8e-99f7-326cd8377c7c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:06.718290 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f3cdf03a-3d32-4f8e-99f7-326cd8377c7c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.157215 Jan 17 21:27:06.718904 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 428/857] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:06 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:27:07.735704 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-749e93ca-d034-478c-84b8-cd9ab39a85f3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:07.737602 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-749e93ca-d034-478c-84b8-cd9ab39a85f3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:07.743268 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-749e93ca-d034-478c-84b8-cd9ab39a85f3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:07.743795 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-749e93ca-d034-478c-84b8-cd9ab39a85f3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:07.744741 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-749e93ca-d034-478c-84b8-cd9ab39a85f3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:07.745364 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-749e93ca-d034-478c-84b8-cd9ab39a85f3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:07.891592 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-749e93ca-d034-478c-84b8-cd9ab39a85f3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:07.899596 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-749e93ca-d034-478c-84b8-cd9ab39a85f3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.167685 Jan 17 21:27:07.900403 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 429/858] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:07 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:27:08.726436 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:27:08.726693 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: Mon Jan 17 21:27:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 21:27:08.916851 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d19475d2-af04-4850-9114-41b266f074c0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:08.917595 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d19475d2-af04-4850-9114-41b266f074c0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:08.924430 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d19475d2-af04-4850-9114-41b266f074c0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:08.924872 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d19475d2-af04-4850-9114-41b266f074c0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:08.925664 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d19475d2-af04-4850-9114-41b266f074c0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:08.926095 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d19475d2-af04-4850-9114-41b266f074c0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:09.066811 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d19475d2-af04-4850-9114-41b266f074c0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:09.074449 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d19475d2-af04-4850-9114-41b266f074c0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.161256 Jan 17 21:27:09.075007 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 430/859] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:08 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:27:10.091592 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d3b9bf8e-45ab-4072-8541-0e05cfdce39e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:10.092574 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d3b9bf8e-45ab-4072-8541-0e05cfdce39e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:10.099164 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d3b9bf8e-45ab-4072-8541-0e05cfdce39e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:10.099618 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d3b9bf8e-45ab-4072-8541-0e05cfdce39e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:10.100449 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d3b9bf8e-45ab-4072-8541-0e05cfdce39e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:10.100889 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d3b9bf8e-45ab-4072-8541-0e05cfdce39e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:10.252761 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d3b9bf8e-45ab-4072-8541-0e05cfdce39e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:10.260502 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d3b9bf8e-45ab-4072-8541-0e05cfdce39e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.172743 Jan 17 21:27:10.261087 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 431/860] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:10 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:27:11.277954 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a6d7aa77-ac17-41fe-9b43-b07b84584481 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:11.278607 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a6d7aa77-ac17-41fe-9b43-b07b84584481 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:11.285213 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a6d7aa77-ac17-41fe-9b43-b07b84584481 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:11.285677 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a6d7aa77-ac17-41fe-9b43-b07b84584481 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:11.286473 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a6d7aa77-ac17-41fe-9b43-b07b84584481 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:11.286915 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a6d7aa77-ac17-41fe-9b43-b07b84584481 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:11.429684 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a6d7aa77-ac17-41fe-9b43-b07b84584481 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:11.439402 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a6d7aa77-ac17-41fe-9b43-b07b84584481 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.165680 Jan 17 21:27:11.439977 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 432/861] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:11 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:27:12.455478 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6b88bf0b-526c-4b8c-841e-e610ecab9c98 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:12.456184 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6b88bf0b-526c-4b8c-841e-e610ecab9c98 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:12.462787 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6b88bf0b-526c-4b8c-841e-e610ecab9c98 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:12.463244 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6b88bf0b-526c-4b8c-841e-e610ecab9c98 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:12.464037 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6b88bf0b-526c-4b8c-841e-e610ecab9c98 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:12.464505 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6b88bf0b-526c-4b8c-841e-e610ecab9c98 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:12.601289 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6b88bf0b-526c-4b8c-841e-e610ecab9c98 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:12.610362 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6b88bf0b-526c-4b8c-841e-e610ecab9c98 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.158547 Jan 17 21:27:12.610945 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 433/862] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:12 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:27:13.627328 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1279c1d2-270f-464f-8c5a-8119cd86bc3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:13.628035 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1279c1d2-270f-464f-8c5a-8119cd86bc3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:13.635240 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1279c1d2-270f-464f-8c5a-8119cd86bc3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:13.635707 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1279c1d2-270f-464f-8c5a-8119cd86bc3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:13.636538 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1279c1d2-270f-464f-8c5a-8119cd86bc3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:13.637621 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1279c1d2-270f-464f-8c5a-8119cd86bc3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:13.779686 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1279c1d2-270f-464f-8c5a-8119cd86bc3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:13.789654 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1279c1d2-270f-464f-8c5a-8119cd86bc3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.165929 Jan 17 21:27:13.790329 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 434/863] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:13 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:27:14.806921 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0ca69b62-5244-479d-9061-4b7e42db351d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:14.807588 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0ca69b62-5244-479d-9061-4b7e42db351d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:14.814529 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0ca69b62-5244-479d-9061-4b7e42db351d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:14.814987 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0ca69b62-5244-479d-9061-4b7e42db351d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:14.815789 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0ca69b62-5244-479d-9061-4b7e42db351d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:14.816232 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0ca69b62-5244-479d-9061-4b7e42db351d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:14.949031 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-0ca69b62-5244-479d-9061-4b7e42db351d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:14.956658 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0ca69b62-5244-479d-9061-4b7e42db351d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.153837 Jan 17 21:27:14.957225 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 435/864] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:14 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:27:15.974397 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5a73b0e1-595f-41e9-b734-064a73e3e46b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:15.975077 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5a73b0e1-595f-41e9-b734-064a73e3e46b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:15.982208 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a73b0e1-595f-41e9-b734-064a73e3e46b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:15.982665 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a73b0e1-595f-41e9-b734-064a73e3e46b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:15.983469 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a73b0e1-595f-41e9-b734-064a73e3e46b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:15.983916 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a73b0e1-595f-41e9-b734-064a73e3e46b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:16.123217 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5a73b0e1-595f-41e9-b734-064a73e3e46b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:16.131048 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5a73b0e1-595f-41e9-b734-064a73e3e46b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.160267 Jan 17 21:27:16.131630 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 436/865] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:15 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:27:16.829346 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-559d0dc5-0680-4138-9a84-55b840cbc733 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 200 len: 38381 microversion: 2.20 time: 12.698931 Jan 17 21:27:16.829978 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 430/866] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:27:04 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 38381 bytes in 12701 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:27:16.840511 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e55573cf-5b5a-46b0-a1e8-eb51379e3760 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:16.841021 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e55573cf-5b5a-46b0-a1e8-eb51379e3760 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:16.846838 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e55573cf-5b5a-46b0-a1e8-eb51379e3760 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:16.847295 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e55573cf-5b5a-46b0-a1e8-eb51379e3760 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:16.848094 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e55573cf-5b5a-46b0-a1e8-eb51379e3760 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:16.848567 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e55573cf-5b5a-46b0-a1e8-eb51379e3760 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:16.872557 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e55573cf-5b5a-46b0-a1e8-eb51379e3760 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/ips" status: 200 len: 153 microversion: 2.20 time: 0.035728 Jan 17 21:27:16.873135 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 437/867] 10.222.0.64 () {60 vars in 1288 bytes} [Mon Jan 17 21:27:16 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/ips => generated 153 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:27:17.150346 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b21ce1fa-3cf0-46db-8bcd-0addea1bb1b6 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:17.151486 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b21ce1fa-3cf0-46db-8bcd-0addea1bb1b6 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:17.162881 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b21ce1fa-3cf0-46db-8bcd-0addea1bb1b6 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:17.163698 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b21ce1fa-3cf0-46db-8bcd-0addea1bb1b6 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:17.165833 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b21ce1fa-3cf0-46db-8bcd-0addea1bb1b6 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:17.166400 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b21ce1fa-3cf0-46db-8bcd-0addea1bb1b6 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:17.339333 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b21ce1fa-3cf0-46db-8bcd-0addea1bb1b6 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:17.348254 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b21ce1fa-3cf0-46db-8bcd-0addea1bb1b6 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.202842 Jan 17 21:27:17.349012 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 431/868] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:17 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:27:17.443623 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-48984d36-8cbc-4c89-b4c7-45926e4f3807 req-c6ffd1a6-9e3a-484d-bbfa-48a5ec0dc6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750a4c55-b8a2-4303-a261-db81409d8b93", "tag": "8071f514-88c2-4831-9268-624212bd59d9"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:17.446435 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:27:17.446435 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:27:17.457108 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-48984d36-8cbc-4c89-b4c7-45926e4f3807 req-c6ffd1a6-9e3a-484d-bbfa-48a5ec0dc6e0 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:17.459323 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-48984d36-8cbc-4c89-b4c7-45926e4f3807 req-c6ffd1a6-9e3a-484d-bbfa-48a5ec0dc6e0 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:17.475366 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-48984d36-8cbc-4c89-b4c7-45926e4f3807 req-c6ffd1a6-9e3a-484d-bbfa-48a5ec0dc6e0 service nova] Creating event network-changed:8071f514-88c2-4831-9268-624212bd59d9 for instance 750a4c55-b8a2-4303-a261-db81409d8b93 on hv-cinder-82489 Jan 17 21:27:17.487898 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-48984d36-8cbc-4c89-b4c7-45926e4f3807 req-c6ffd1a6-9e3a-484d-bbfa-48a5ec0dc6e0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047685 Jan 17 21:27:17.489139 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 438/869] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:27:18.366467 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-46ebb2fd-3f8b-4c23-929a-8625cbe16653 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:18.367628 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-46ebb2fd-3f8b-4c23-929a-8625cbe16653 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:18.379256 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-46ebb2fd-3f8b-4c23-929a-8625cbe16653 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:18.379713 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-46ebb2fd-3f8b-4c23-929a-8625cbe16653 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:18.380557 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-46ebb2fd-3f8b-4c23-929a-8625cbe16653 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:18.381012 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-46ebb2fd-3f8b-4c23-929a-8625cbe16653 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:18.521813 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-46ebb2fd-3f8b-4c23-929a-8625cbe16653 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:18.530852 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-46ebb2fd-3f8b-4c23-929a-8625cbe16653 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.168893 Jan 17 21:27:18.531438 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 432/870] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:18 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:27:19.549809 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5c12f775-4529-49c2-b590-682a9fdb532b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:19.550435 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5c12f775-4529-49c2-b590-682a9fdb532b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:19.556903 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5c12f775-4529-49c2-b590-682a9fdb532b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:19.557361 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5c12f775-4529-49c2-b590-682a9fdb532b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:19.558178 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5c12f775-4529-49c2-b590-682a9fdb532b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:19.559126 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5c12f775-4529-49c2-b590-682a9fdb532b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:19.698057 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5c12f775-4529-49c2-b590-682a9fdb532b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:19.706218 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5c12f775-4529-49c2-b590-682a9fdb532b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.161459 Jan 17 21:27:19.706809 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 439/871] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:19 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:27:20.411823 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a62e45ec-ff48-4649-aa97-a0ed52ee976f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:20.412573 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a62e45ec-ff48-4649-aa97-a0ed52ee976f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:20.419378 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a62e45ec-ff48-4649-aa97-a0ed52ee976f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:20.419904 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a62e45ec-ff48-4649-aa97-a0ed52ee976f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:20.420684 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a62e45ec-ff48-4649-aa97-a0ed52ee976f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:20.421122 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a62e45ec-ff48-4649-aa97-a0ed52ee976f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:20.445585 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.objects.instance [None req-a62e45ec-ff48-4649-aa97-a0ed52ee976f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lazy-loading 'flavor' on Instance uuid 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 {{(pid=116183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:27:20.718663 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a62e45ec-ff48-4649-aa97-a0ed52ee976f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 202 len: 0 microversion: 2.20 time: 0.310368 Jan 17 21:27:20.719758 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 433/872] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:27:20 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:27:20.728869 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-84996b8b-b014-4eb1-a0ea-55495bb4118d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:20.729909 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-84996b8b-b014-4eb1-a0ea-55495bb4118d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:20.733289 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8a59ecac-7a9d-4c12-be81-38e4e64812e6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:20.734491 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8a59ecac-7a9d-4c12-be81-38e4e64812e6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:20.741298 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-84996b8b-b014-4eb1-a0ea-55495bb4118d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:20.742044 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-84996b8b-b014-4eb1-a0ea-55495bb4118d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:20.743408 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-84996b8b-b014-4eb1-a0ea-55495bb4118d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:20.744126 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-84996b8b-b014-4eb1-a0ea-55495bb4118d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:20.745321 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8a59ecac-7a9d-4c12-be81-38e4e64812e6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:20.746053 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8a59ecac-7a9d-4c12-be81-38e4e64812e6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:20.747427 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8a59ecac-7a9d-4c12-be81-38e4e64812e6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:20.748154 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8a59ecac-7a9d-4c12-be81-38e4e64812e6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:20.951549 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-84996b8b-b014-4eb1-a0ea-55495bb4118d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:20.955358 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8a59ecac-7a9d-4c12-be81-38e4e64812e6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:20.959693 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-84996b8b-b014-4eb1-a0ea-55495bb4118d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.237733 Jan 17 21:27:20.960496 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 440/873] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:20 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:27:20.967242 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8a59ecac-7a9d-4c12-be81-38e4e64812e6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:20.967242 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8a59ecac-7a9d-4c12-be81-38e4e64812e6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:20.967242 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8a59ecac-7a9d-4c12-be81-38e4e64812e6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1725 microversion: 2.20 time: 0.241142 Jan 17 21:27:20.967680 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 434/874] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:20 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:21.977923 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7ab90afa-c8fa-40c1-afed-0cd5648022d0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:21.978725 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7ab90afa-c8fa-40c1-afed-0cd5648022d0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:21.985957 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b34e7439-233d-41e8-99c2-aa063d556aaf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:21.986671 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b34e7439-233d-41e8-99c2-aa063d556aaf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:21.986828 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7ab90afa-c8fa-40c1-afed-0cd5648022d0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:21.986828 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7ab90afa-c8fa-40c1-afed-0cd5648022d0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:21.987795 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7ab90afa-c8fa-40c1-afed-0cd5648022d0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:21.988552 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7ab90afa-c8fa-40c1-afed-0cd5648022d0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:21.993166 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b34e7439-233d-41e8-99c2-aa063d556aaf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:21.993902 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b34e7439-233d-41e8-99c2-aa063d556aaf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:21.994708 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b34e7439-233d-41e8-99c2-aa063d556aaf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:21.995147 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b34e7439-233d-41e8-99c2-aa063d556aaf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:22.211049 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7ab90afa-c8fa-40c1-afed-0cd5648022d0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:22.219846 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7ab90afa-c8fa-40c1-afed-0cd5648022d0 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.245536 Jan 17 21:27:22.220458 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 441/875] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:21 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:27:22.224448 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b34e7439-233d-41e8-99c2-aa063d556aaf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:22.233554 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b34e7439-233d-41e8-99c2-aa063d556aaf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:22.235109 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b34e7439-233d-41e8-99c2-aa063d556aaf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:22.236459 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b34e7439-233d-41e8-99c2-aa063d556aaf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1725 microversion: 2.20 time: 0.254421 Jan 17 21:27:22.237026 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 435/876] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:21 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:27:23.237692 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-cafbfc20-e564-43d1-bdaf-4cef1d9fd352 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:23.238236 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-cafbfc20-e564-43d1-bdaf-4cef1d9fd352 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:23.244500 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cafbfc20-e564-43d1-bdaf-4cef1d9fd352 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:23.244959 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cafbfc20-e564-43d1-bdaf-4cef1d9fd352 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:23.246330 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cafbfc20-e564-43d1-bdaf-4cef1d9fd352 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:23.246793 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cafbfc20-e564-43d1-bdaf-4cef1d9fd352 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:23.254989 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3c77af4e-5702-4375-bd96-61c76439aa48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:23.255683 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3c77af4e-5702-4375-bd96-61c76439aa48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:23.262210 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c77af4e-5702-4375-bd96-61c76439aa48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:23.262676 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c77af4e-5702-4375-bd96-61c76439aa48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:23.263482 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c77af4e-5702-4375-bd96-61c76439aa48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:23.263936 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c77af4e-5702-4375-bd96-61c76439aa48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:23.443373 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-cafbfc20-e564-43d1-bdaf-4cef1d9fd352 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:23.453641 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-cafbfc20-e564-43d1-bdaf-4cef1d9fd352 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.219476 Jan 17 21:27:23.454226 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 442/877] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:23 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:27:23.466623 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3c77af4e-5702-4375-bd96-61c76439aa48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:23.474614 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3c77af4e-5702-4375-bd96-61c76439aa48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:23.476116 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3c77af4e-5702-4375-bd96-61c76439aa48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:23.477302 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3c77af4e-5702-4375-bd96-61c76439aa48 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1725 microversion: 2.20 time: 0.226247 Jan 17 21:27:23.477865 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 436/878] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:23 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:27:24.180432 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-81864510-d735-4b2e-b780-e597f3a53496 req-7ee51ff5-08c0-4f74-917d-51eb7e924cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750a4c55-b8a2-4303-a261-db81409d8b93", "name": "network-vif-plugged", "status": "completed", "tag": "8071f514-88c2-4831-9268-624212bd59d9"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:24.182013 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:27:24.182013 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:27:24.189381 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-81864510-d735-4b2e-b780-e597f3a53496 req-7ee51ff5-08c0-4f74-917d-51eb7e924cba service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:24.189828 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-81864510-d735-4b2e-b780-e597f3a53496 req-7ee51ff5-08c0-4f74-917d-51eb7e924cba service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:24.200912 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-81864510-d735-4b2e-b780-e597f3a53496 req-7ee51ff5-08c0-4f74-917d-51eb7e924cba service nova] Creating event network-vif-plugged:8071f514-88c2-4831-9268-624212bd59d9 for instance 750a4c55-b8a2-4303-a261-db81409d8b93 on hv-cinder-82489 Jan 17 21:27:24.205807 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-81864510-d735-4b2e-b780-e597f3a53496 req-7ee51ff5-08c0-4f74-917d-51eb7e924cba service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149113 Jan 17 21:27:24.206376 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 443/879] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:27:24.471657 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2cf763f7-546e-4d42-8579-bbcc7ef681bd tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:24.472295 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2cf763f7-546e-4d42-8579-bbcc7ef681bd tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:24.478781 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2cf763f7-546e-4d42-8579-bbcc7ef681bd tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:24.479233 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2cf763f7-546e-4d42-8579-bbcc7ef681bd tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:24.480588 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2cf763f7-546e-4d42-8579-bbcc7ef681bd tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:24.481035 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2cf763f7-546e-4d42-8579-bbcc7ef681bd tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:24.498156 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b6ab8456-ffb6-4662-b140-069d65092b7e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:24.498890 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b6ab8456-ffb6-4662-b140-069d65092b7e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:24.505513 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b6ab8456-ffb6-4662-b140-069d65092b7e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:24.505873 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b6ab8456-ffb6-4662-b140-069d65092b7e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:24.506667 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b6ab8456-ffb6-4662-b140-069d65092b7e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:24.507105 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b6ab8456-ffb6-4662-b140-069d65092b7e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:24.680203 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2cf763f7-546e-4d42-8579-bbcc7ef681bd tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:24.692568 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b6ab8456-ffb6-4662-b140-069d65092b7e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:24.695969 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2cf763f7-546e-4d42-8579-bbcc7ef681bd tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.227850 Jan 17 21:27:24.696595 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 437/880] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:24 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:27:24.701548 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b6ab8456-ffb6-4662-b140-069d65092b7e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:24.703146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b6ab8456-ffb6-4662-b140-069d65092b7e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:24.704405 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b6ab8456-ffb6-4662-b140-069d65092b7e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1725 microversion: 2.20 time: 0.211397 Jan 17 21:27:24.705053 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 444/881] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:24 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:27:25.713487 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d201f920-a364-4675-948d-f71bddf031de tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:25.714109 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d201f920-a364-4675-948d-f71bddf031de tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:25.722507 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d201f920-a364-4675-948d-f71bddf031de tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:25.722978 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d201f920-a364-4675-948d-f71bddf031de tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:25.723471 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-cd4bcdab-f884-4669-91d2-56bfb286d2bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:25.723950 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d201f920-a364-4675-948d-f71bddf031de tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:25.724187 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d201f920-a364-4675-948d-f71bddf031de tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:25.725027 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-cd4bcdab-f884-4669-91d2-56bfb286d2bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:25.734792 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cd4bcdab-f884-4669-91d2-56bfb286d2bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:25.735519 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cd4bcdab-f884-4669-91d2-56bfb286d2bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:25.736723 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cd4bcdab-f884-4669-91d2-56bfb286d2bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:25.737515 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cd4bcdab-f884-4669-91d2-56bfb286d2bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:25.943921 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-d201f920-a364-4675-948d-f71bddf031de tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:25.948236 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-cd4bcdab-f884-4669-91d2-56bfb286d2bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:25.952930 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d201f920-a364-4675-948d-f71bddf031de tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1358 microversion: 2.1 time: 0.243165 Jan 17 21:27:25.956413 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 438/882] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:25 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:27:25.972050 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-cd4bcdab-f884-4669-91d2-56bfb286d2bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:25.973603 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-cd4bcdab-f884-4669-91d2-56bfb286d2bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:25.974890 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-cd4bcdab-f884-4669-91d2-56bfb286d2bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1725 microversion: 2.20 time: 0.255824 Jan 17 21:27:25.975450 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 445/883] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:25 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:27:26.970081 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8494f202-4def-4278-86e3-926215afe1f7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:26.970696 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8494f202-4def-4278-86e3-926215afe1f7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:26.977341 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8494f202-4def-4278-86e3-926215afe1f7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:26.977799 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8494f202-4def-4278-86e3-926215afe1f7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:26.978640 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8494f202-4def-4278-86e3-926215afe1f7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:26.979088 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8494f202-4def-4278-86e3-926215afe1f7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:26.992007 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c7ac4cc7-7a4b-4e40-bfea-f85aee5b05cb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:26.992705 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c7ac4cc7-7a4b-4e40-bfea-f85aee5b05cb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:26.999549 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c7ac4cc7-7a4b-4e40-bfea-f85aee5b05cb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:26.999999 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c7ac4cc7-7a4b-4e40-bfea-f85aee5b05cb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:27.000851 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c7ac4cc7-7a4b-4e40-bfea-f85aee5b05cb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:27.001287 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c7ac4cc7-7a4b-4e40-bfea-f85aee5b05cb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:27.185576 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8494f202-4def-4278-86e3-926215afe1f7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:27.193283 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8494f202-4def-4278-86e3-926215afe1f7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1547 microversion: 2.1 time: 0.226782 Jan 17 21:27:27.193871 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 439/884] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:26 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1547 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:27:27.197298 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c7ac4cc7-7a4b-4e40-bfea-f85aee5b05cb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:27.205427 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c7ac4cc7-7a4b-4e40-bfea-f85aee5b05cb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:27.206933 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c7ac4cc7-7a4b-4e40-bfea-f85aee5b05cb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:27.208126 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c7ac4cc7-7a4b-4e40-bfea-f85aee5b05cb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1725 microversion: 2.20 time: 0.219938 Jan 17 21:27:27.208726 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 446/885] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:26 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:27:27.209797 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-31bcc3b1-4942-4fb0-bb07-b88fbef51a43 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:27.210429 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-31bcc3b1-4942-4fb0-bb07-b88fbef51a43 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:27.217378 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-31bcc3b1-4942-4fb0-bb07-b88fbef51a43 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:27.217966 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-31bcc3b1-4942-4fb0-bb07-b88fbef51a43 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:27.218860 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-31bcc3b1-4942-4fb0-bb07-b88fbef51a43 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:27.219363 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-31bcc3b1-4942-4fb0-bb07-b88fbef51a43 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:27.346427 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-31bcc3b1-4942-4fb0-bb07-b88fbef51a43 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:27.353914 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-31bcc3b1-4942-4fb0-bb07-b88fbef51a43 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1547 microversion: 2.1 time: 0.148319 Jan 17 21:27:27.354479 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 440/886] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:27 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:27:27.369874 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c884f4f5-7f98-42f0-834d-37e14a67680e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:27.373355 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:27:27.373355 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:27:27.374342 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c884f4f5-7f98-42f0-834d-37e14a67680e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:27.375087 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c884f4f5-7f98-42f0-834d-37e14a67680e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Searching by: {'deleted': False, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876'} {{(pid=116182) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 17 21:27:27.381668 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c884f4f5-7f98-42f0-834d-37e14a67680e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:27.382120 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c884f4f5-7f98-42f0-834d-37e14a67680e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:27.382940 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c884f4f5-7f98-42f0-834d-37e14a67680e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:27.383380 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c884f4f5-7f98-42f0-834d-37e14a67680e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:27.471464 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.multi_cell_list [None req-c884f4f5-7f98-42f0-834d-37e14a67680e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116182) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 17 21:27:27.561313 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c884f4f5-7f98-42f0-834d-37e14a67680e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.194840 Jan 17 21:27:27.561812 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 447/887] 10.222.0.64 () {58 vars in 1124 bytes} [Mon Jan 17 21:27:27 2022] GET /compute/v2.1/servers => generated 343 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:27:27.571707 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-dfa5dea7-e4b4-44d4-9e80-66f95361dcf7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:27.572319 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-dfa5dea7-e4b4-44d4-9e80-66f95361dcf7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:27.578760 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dfa5dea7-e4b4-44d4-9e80-66f95361dcf7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:27.579219 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dfa5dea7-e4b4-44d4-9e80-66f95361dcf7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:27.580000 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dfa5dea7-e4b4-44d4-9e80-66f95361dcf7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:27.580481 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dfa5dea7-e4b4-44d4-9e80-66f95361dcf7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:27.711545 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-dfa5dea7-e4b4-44d4-9e80-66f95361dcf7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:27.719409 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-dfa5dea7-e4b4-44d4-9e80-66f95361dcf7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1547 microversion: 2.1 time: 0.151262 Jan 17 21:27:27.719972 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 441/888] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:27 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:27:28.227124 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7dc8fa05-f8f5-4c56-8886-0f6b17f017be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:28.227707 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7dc8fa05-f8f5-4c56-8886-0f6b17f017be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:28.234752 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7dc8fa05-f8f5-4c56-8886-0f6b17f017be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:28.235217 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7dc8fa05-f8f5-4c56-8886-0f6b17f017be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:28.236512 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7dc8fa05-f8f5-4c56-8886-0f6b17f017be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:28.237333 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7dc8fa05-f8f5-4c56-8886-0f6b17f017be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:28.374710 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7dc8fa05-f8f5-4c56-8886-0f6b17f017be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:28.382833 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7dc8fa05-f8f5-4c56-8886-0f6b17f017be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:28.384349 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7dc8fa05-f8f5-4c56-8886-0f6b17f017be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:28.385533 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7dc8fa05-f8f5-4c56-8886-0f6b17f017be tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1725 microversion: 2.20 time: 0.162319 Jan 17 21:27:28.386121 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 448/889] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:28 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:29.212231 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-fb080356-7355-4f3d-ba42-2b57a10a27b9 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9af4222d-3dd3-46a3-973d-e0af6b680526"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:29.213406 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-fb080356-7355-4f3d-ba42-2b57a10a27b9 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:29.220258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fb080356-7355-4f3d-ba42-2b57a10a27b9 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:29.220753 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fb080356-7355-4f3d-ba42-2b57a10a27b9 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:29.221541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fb080356-7355-4f3d-ba42-2b57a10a27b9 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:29.221985 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-fb080356-7355-4f3d-ba42-2b57a10a27b9 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:29.403213 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5355daa4-5ced-4088-9678-f41f19afef04 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:29.403854 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5355daa4-5ced-4088-9678-f41f19afef04 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:29.410404 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5355daa4-5ced-4088-9678-f41f19afef04 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:29.410865 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5355daa4-5ced-4088-9678-f41f19afef04 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:29.411660 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5355daa4-5ced-4088-9678-f41f19afef04 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:29.412136 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5355daa4-5ced-4088-9678-f41f19afef04 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:29.446780 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-fb080356-7355-4f3d-ba42-2b57a10a27b9 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "POST /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.238265 Jan 17 21:27:29.447620 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 442/890] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jan 17 21:27:29 2022] POST /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/os-volume_attachments => generated 194 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:27:29.560796 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5355daa4-5ced-4088-9678-f41f19afef04 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:29.568881 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5355daa4-5ced-4088-9678-f41f19afef04 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:29.570378 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5355daa4-5ced-4088-9678-f41f19afef04 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:29.571524 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5355daa4-5ced-4088-9678-f41f19afef04 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1725 microversion: 2.20 time: 0.172074 Jan 17 21:27:29.572074 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 449/891] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:29 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:30.592063 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1057fed3-bbf6-4122-9d88-8687c9911198 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:30.592781 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1057fed3-bbf6-4122-9d88-8687c9911198 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:30.601606 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1057fed3-bbf6-4122-9d88-8687c9911198 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:30.602067 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1057fed3-bbf6-4122-9d88-8687c9911198 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:30.602860 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1057fed3-bbf6-4122-9d88-8687c9911198 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:30.605087 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1057fed3-bbf6-4122-9d88-8687c9911198 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:30.754717 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1057fed3-bbf6-4122-9d88-8687c9911198 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:30.764135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1057fed3-bbf6-4122-9d88-8687c9911198 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:30.765822 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1057fed3-bbf6-4122-9d88-8687c9911198 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:30.767025 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1057fed3-bbf6-4122-9d88-8687c9911198 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1725 microversion: 2.20 time: 0.180234 Jan 17 21:27:30.767582 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 443/892] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:30 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:31.785326 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-95b7ddd8-9ddc-41a6-a911-74c1e5386fc3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:31.785878 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-95b7ddd8-9ddc-41a6-a911-74c1e5386fc3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:31.792320 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-95b7ddd8-9ddc-41a6-a911-74c1e5386fc3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:31.793411 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-95b7ddd8-9ddc-41a6-a911-74c1e5386fc3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:31.794209 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-95b7ddd8-9ddc-41a6-a911-74c1e5386fc3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:31.794651 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-95b7ddd8-9ddc-41a6-a911-74c1e5386fc3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:31.930122 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-95b7ddd8-9ddc-41a6-a911-74c1e5386fc3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:31.941803 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-95b7ddd8-9ddc-41a6-a911-74c1e5386fc3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:31.943298 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-95b7ddd8-9ddc-41a6-a911-74c1e5386fc3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:31.944513 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-95b7ddd8-9ddc-41a6-a911-74c1e5386fc3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1725 microversion: 2.20 time: 0.162993 Jan 17 21:27:31.945070 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 450/893] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:31 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:32.964208 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-353bdf88-eb50-4e7a-8b79-592144dbbc68 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:32.964788 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-353bdf88-eb50-4e7a-8b79-592144dbbc68 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:32.971300 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-353bdf88-eb50-4e7a-8b79-592144dbbc68 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:32.971750 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-353bdf88-eb50-4e7a-8b79-592144dbbc68 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:32.972571 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-353bdf88-eb50-4e7a-8b79-592144dbbc68 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:32.973013 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-353bdf88-eb50-4e7a-8b79-592144dbbc68 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:33.112633 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-353bdf88-eb50-4e7a-8b79-592144dbbc68 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:33.120696 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-353bdf88-eb50-4e7a-8b79-592144dbbc68 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:33.122200 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-353bdf88-eb50-4e7a-8b79-592144dbbc68 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:33.123357 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-353bdf88-eb50-4e7a-8b79-592144dbbc68 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1746 microversion: 2.20 time: 0.162967 Jan 17 21:27:33.123915 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 444/894] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:32 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:34.149042 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-16206328-05e0-4520-8c9a-cbad71d0b332 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:34.149873 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-16206328-05e0-4520-8c9a-cbad71d0b332 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:34.155963 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-16206328-05e0-4520-8c9a-cbad71d0b332 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:34.156503 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-16206328-05e0-4520-8c9a-cbad71d0b332 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:34.157370 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-16206328-05e0-4520-8c9a-cbad71d0b332 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:34.157817 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-16206328-05e0-4520-8c9a-cbad71d0b332 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:34.290940 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-16206328-05e0-4520-8c9a-cbad71d0b332 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:34.299932 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-16206328-05e0-4520-8c9a-cbad71d0b332 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:34.301648 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-16206328-05e0-4520-8c9a-cbad71d0b332 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:34.302901 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-16206328-05e0-4520-8c9a-cbad71d0b332 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1746 microversion: 2.20 time: 0.157617 Jan 17 21:27:34.303769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 451/895] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:34 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:35.321800 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2a2dc313-73e0-4fed-b3b6-7d8f57cb2717 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:35.322333 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2a2dc313-73e0-4fed-b3b6-7d8f57cb2717 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:35.329318 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a2dc313-73e0-4fed-b3b6-7d8f57cb2717 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:35.329769 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a2dc313-73e0-4fed-b3b6-7d8f57cb2717 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:35.330588 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a2dc313-73e0-4fed-b3b6-7d8f57cb2717 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:35.331032 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a2dc313-73e0-4fed-b3b6-7d8f57cb2717 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:35.472710 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2a2dc313-73e0-4fed-b3b6-7d8f57cb2717 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:35.481052 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2a2dc313-73e0-4fed-b3b6-7d8f57cb2717 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:35.482558 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2a2dc313-73e0-4fed-b3b6-7d8f57cb2717 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:35.483801 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2a2dc313-73e0-4fed-b3b6-7d8f57cb2717 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1746 microversion: 2.20 time: 0.165773 Jan 17 21:27:35.484395 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 445/896] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:35 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:36.124293 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-022ccd01-4729-44a9-bb5c-c023bbcf5243 req-b5e40c2a-9a67-448e-b114-ee49a708914e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5edb3c99-d30d-4a2c-8b50-5083b7ea9d96", "name": "network-vif-plugged", "status": "completed", "tag": "dde4fe76-f1d0-4978-a642-2a35761fdf74"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:36.125776 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:27:36.125776 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:27:36.134396 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-022ccd01-4729-44a9-bb5c-c023bbcf5243 req-b5e40c2a-9a67-448e-b114-ee49a708914e service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:36.134896 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-022ccd01-4729-44a9-bb5c-c023bbcf5243 req-b5e40c2a-9a67-448e-b114-ee49a708914e service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:36.152960 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-022ccd01-4729-44a9-bb5c-c023bbcf5243 req-b5e40c2a-9a67-448e-b114-ee49a708914e service nova] Creating event network-vif-plugged:dde4fe76-f1d0-4978-a642-2a35761fdf74 for instance 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 on hv-cinder-82489 Jan 17 21:27:36.161849 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-022ccd01-4729-44a9-bb5c-c023bbcf5243 req-b5e40c2a-9a67-448e-b114-ee49a708914e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040631 Jan 17 21:27:36.162897 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 452/897] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:27:36.510305 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-411ab100-ec23-48b4-bf60-b27a70cd1be3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:36.511729 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-411ab100-ec23-48b4-bf60-b27a70cd1be3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:36.518653 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-411ab100-ec23-48b4-bf60-b27a70cd1be3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:36.519080 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-411ab100-ec23-48b4-bf60-b27a70cd1be3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:36.519880 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-411ab100-ec23-48b4-bf60-b27a70cd1be3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:36.520358 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-411ab100-ec23-48b4-bf60-b27a70cd1be3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:36.670465 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-411ab100-ec23-48b4-bf60-b27a70cd1be3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:36.680409 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-411ab100-ec23-48b4-bf60-b27a70cd1be3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:36.683005 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-411ab100-ec23-48b4-bf60-b27a70cd1be3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:36.685128 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-411ab100-ec23-48b4-bf60-b27a70cd1be3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1746 microversion: 2.20 time: 0.178361 Jan 17 21:27:36.686147 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 446/898] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:36 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1746 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:36.977050 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-60e6970f-d8ee-4fab-9a49-2faf17d93175 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:36.977744 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-60e6970f-d8ee-4fab-9a49-2faf17d93175 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:36.984162 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60e6970f-d8ee-4fab-9a49-2faf17d93175 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:36.984652 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60e6970f-d8ee-4fab-9a49-2faf17d93175 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:36.985449 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60e6970f-d8ee-4fab-9a49-2faf17d93175 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:36.985887 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60e6970f-d8ee-4fab-9a49-2faf17d93175 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:37.122352 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-60e6970f-d8ee-4fab-9a49-2faf17d93175 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:37.130303 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-60e6970f-d8ee-4fab-9a49-2faf17d93175 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1593 microversion: 2.1 time: 0.157268 Jan 17 21:27:37.130900 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 453/899] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:36 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1593 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:27:37.705037 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e35096e1-a905-4386-9680-0adadfdbba78 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:37.705750 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-e35096e1-a905-4386-9680-0adadfdbba78 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:37.712960 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e35096e1-a905-4386-9680-0adadfdbba78 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:37.713371 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e35096e1-a905-4386-9680-0adadfdbba78 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:37.714061 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e35096e1-a905-4386-9680-0adadfdbba78 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:37.715020 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e35096e1-a905-4386-9680-0adadfdbba78 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:37.865114 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-e35096e1-a905-4386-9680-0adadfdbba78 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:37.873956 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-e35096e1-a905-4386-9680-0adadfdbba78 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:37.875453 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-e35096e1-a905-4386-9680-0adadfdbba78 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:37.876740 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e35096e1-a905-4386-9680-0adadfdbba78 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1746 microversion: 2.20 time: 0.175413 Jan 17 21:27:37.877316 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 447/900] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:37 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:38.904107 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f28b665f-f7a5-48fe-876e-8766c19baf15 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:38.906495 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f28b665f-f7a5-48fe-876e-8766c19baf15 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:38.913362 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f28b665f-f7a5-48fe-876e-8766c19baf15 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:38.916753 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f28b665f-f7a5-48fe-876e-8766c19baf15 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:38.918489 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f28b665f-f7a5-48fe-876e-8766c19baf15 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:38.919117 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f28b665f-f7a5-48fe-876e-8766c19baf15 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:39.077790 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f28b665f-f7a5-48fe-876e-8766c19baf15 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:39.086889 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f28b665f-f7a5-48fe-876e-8766c19baf15 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:39.088796 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f28b665f-f7a5-48fe-876e-8766c19baf15 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:39.090801 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f28b665f-f7a5-48fe-876e-8766c19baf15 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1741 microversion: 2.20 time: 0.191414 Jan 17 21:27:39.102989 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 454/901] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:38 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:39.121221 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-46f3b9a7-7638-4451-adaa-099e10e8777d req-d661c23b-516c-4888-a532-d9240521da3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750a4c55-b8a2-4303-a261-db81409d8b93", "tag": "8071f514-88c2-4831-9268-624212bd59d9"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:39.123134 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:27:39.123134 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:27:39.133902 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-46f3b9a7-7638-4451-adaa-099e10e8777d req-d661c23b-516c-4888-a532-d9240521da3a service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:39.135297 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-46f3b9a7-7638-4451-adaa-099e10e8777d req-d661c23b-516c-4888-a532-d9240521da3a service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:39.151017 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-46f3b9a7-7638-4451-adaa-099e10e8777d req-d661c23b-516c-4888-a532-d9240521da3a service nova] Creating event network-changed:8071f514-88c2-4831-9268-624212bd59d9 for instance 750a4c55-b8a2-4303-a261-db81409d8b93 on hv-cinder-82489 Jan 17 21:27:39.157898 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-46f3b9a7-7638-4451-adaa-099e10e8777d req-d661c23b-516c-4888-a532-d9240521da3a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040400 Jan 17 21:27:39.164027 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 448/902] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:27:40.110701 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5b11d9de-41bf-4efe-a7d6-8a82aa01f46e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:40.111626 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5b11d9de-41bf-4efe-a7d6-8a82aa01f46e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:40.124923 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5b11d9de-41bf-4efe-a7d6-8a82aa01f46e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:40.126513 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5b11d9de-41bf-4efe-a7d6-8a82aa01f46e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:40.127596 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5b11d9de-41bf-4efe-a7d6-8a82aa01f46e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:40.134603 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5b11d9de-41bf-4efe-a7d6-8a82aa01f46e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:40.378539 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5b11d9de-41bf-4efe-a7d6-8a82aa01f46e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:40.400892 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5b11d9de-41bf-4efe-a7d6-8a82aa01f46e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:40.404117 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5b11d9de-41bf-4efe-a7d6-8a82aa01f46e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:40.405379 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5b11d9de-41bf-4efe-a7d6-8a82aa01f46e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1741 microversion: 2.20 time: 0.298654 Jan 17 21:27:40.433474 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 455/903] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:40 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1741 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:40.863139 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-bb9bf676-45a8-408c-90bf-8f11e1bb5e85 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-517440629"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:40.863751 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-bb9bf676-45a8-408c-90bf-8f11e1bb5e85 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:40.870683 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bb9bf676-45a8-408c-90bf-8f11e1bb5e85 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:40.871760 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bb9bf676-45a8-408c-90bf-8f11e1bb5e85 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:40.872665 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bb9bf676-45a8-408c-90bf-8f11e1bb5e85 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:40.873170 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bb9bf676-45a8-408c-90bf-8f11e1bb5e85 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:41.088770 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.network.security_group_api [None req-bb9bf676-45a8-408c-90bf-8f11e1bb5e85 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Adding security group a1a863a3-d208-4bbc-be40-7af063b28fb8 to port 8071f514-88c2-4831-9268-624212bd59d9 Jan 17 21:27:41.430765 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-35e58506-f639-4fed-9b01-86c8095014c0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:41.435033 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-35e58506-f639-4fed-9b01-86c8095014c0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:41.443745 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35e58506-f639-4fed-9b01-86c8095014c0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:41.444611 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35e58506-f639-4fed-9b01-86c8095014c0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:41.446058 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35e58506-f639-4fed-9b01-86c8095014c0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:41.448721 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35e58506-f639-4fed-9b01-86c8095014c0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:41.694326 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-bb9bf676-45a8-408c-90bf-8f11e1bb5e85 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "POST /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/action" status: 202 len: 0 microversion: 2.1 time: 0.836966 Jan 17 21:27:41.695418 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 449/904] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:27:40 2022] POST /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/action => generated 0 bytes in 839 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:27:41.717491 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-d0d3176e-274b-4cbb-a1f4-edeaaf73a354 req-a07b7b50-8958-47d3-b055-fa5155534261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750a4c55-b8a2-4303-a261-db81409d8b93", "tag": "8071f514-88c2-4831-9268-624212bd59d9"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:41.726192 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:27:41.726192 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:27:41.740301 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-d0d3176e-274b-4cbb-a1f4-edeaaf73a354 req-a07b7b50-8958-47d3-b055-fa5155534261 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:41.741065 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-d0d3176e-274b-4cbb-a1f4-edeaaf73a354 req-a07b7b50-8958-47d3-b055-fa5155534261 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:41.765904 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-d0d3176e-274b-4cbb-a1f4-edeaaf73a354 req-a07b7b50-8958-47d3-b055-fa5155534261 service nova] Creating event network-changed:8071f514-88c2-4831-9268-624212bd59d9 for instance 750a4c55-b8a2-4303-a261-db81409d8b93 on hv-cinder-82489 Jan 17 21:27:41.774307 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-d0d3176e-274b-4cbb-a1f4-edeaaf73a354 req-a07b7b50-8958-47d3-b055-fa5155534261 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077312 Jan 17 21:27:41.775232 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 450/905] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:27:41.801199 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-dd5c5cc0-e380-471e-9cb1-abcc11cc2eb3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:41.802219 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-dd5c5cc0-e380-471e-9cb1-abcc11cc2eb3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:41.817442 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dd5c5cc0-e380-471e-9cb1-abcc11cc2eb3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:41.819122 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dd5c5cc0-e380-471e-9cb1-abcc11cc2eb3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:41.822061 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-35e58506-f639-4fed-9b01-86c8095014c0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:41.829625 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dd5c5cc0-e380-471e-9cb1-abcc11cc2eb3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:41.830092 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dd5c5cc0-e380-471e-9cb1-abcc11cc2eb3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:41.833329 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-35e58506-f639-4fed-9b01-86c8095014c0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:41.835127 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-35e58506-f639-4fed-9b01-86c8095014c0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:41.836311 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-35e58506-f639-4fed-9b01-86c8095014c0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1741 microversion: 2.20 time: 0.416446 Jan 17 21:27:41.849116 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 456/906] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:41 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1741 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:27:42.119960 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-dd5c5cc0-e380-471e-9cb1-abcc11cc2eb3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:42.128858 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-dd5c5cc0-e380-471e-9cb1-abcc11cc2eb3 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1757 microversion: 2.1 time: 0.346134 Jan 17 21:27:42.129442 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 451/907] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:27:41 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1757 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:27:42.868468 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ab77104e-9dae-44fa-a7b9-33340543b8b0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:42.869286 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ab77104e-9dae-44fa-a7b9-33340543b8b0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:42.876657 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ab77104e-9dae-44fa-a7b9-33340543b8b0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:42.877496 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ab77104e-9dae-44fa-a7b9-33340543b8b0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:42.878370 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ab77104e-9dae-44fa-a7b9-33340543b8b0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:42.878876 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ab77104e-9dae-44fa-a7b9-33340543b8b0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:43.070576 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ab77104e-9dae-44fa-a7b9-33340543b8b0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:43.080132 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ab77104e-9dae-44fa-a7b9-33340543b8b0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:43.082485 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ab77104e-9dae-44fa-a7b9-33340543b8b0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:43.084464 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ab77104e-9dae-44fa-a7b9-33340543b8b0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1741 microversion: 2.20 time: 0.220286 Jan 17 21:27:43.085314 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 457/908] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:42 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1741 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:27:44.110921 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-677e92c4-7004-4553-8e9b-eed41add0de2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:44.111864 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-677e92c4-7004-4553-8e9b-eed41add0de2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:44.122806 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-677e92c4-7004-4553-8e9b-eed41add0de2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:44.124063 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-677e92c4-7004-4553-8e9b-eed41add0de2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:44.125792 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-677e92c4-7004-4553-8e9b-eed41add0de2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:44.127824 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-677e92c4-7004-4553-8e9b-eed41add0de2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:44.280106 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-677e92c4-7004-4553-8e9b-eed41add0de2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:44.288652 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-677e92c4-7004-4553-8e9b-eed41add0de2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:44.290120 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-677e92c4-7004-4553-8e9b-eed41add0de2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:44.291285 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-677e92c4-7004-4553-8e9b-eed41add0de2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1741 microversion: 2.20 time: 0.187677 Jan 17 21:27:44.291836 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 452/909] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:44 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:27:45.310491 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-575c4df3-1a6c-43a5-ad12-a1de27eab915 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:45.311119 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-575c4df3-1a6c-43a5-ad12-a1de27eab915 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:45.319079 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-575c4df3-1a6c-43a5-ad12-a1de27eab915 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:45.320131 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-575c4df3-1a6c-43a5-ad12-a1de27eab915 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:45.320329 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-575c4df3-1a6c-43a5-ad12-a1de27eab915 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:45.320790 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-575c4df3-1a6c-43a5-ad12-a1de27eab915 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:45.474018 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-575c4df3-1a6c-43a5-ad12-a1de27eab915 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:45.482547 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-575c4df3-1a6c-43a5-ad12-a1de27eab915 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:45.484035 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-575c4df3-1a6c-43a5-ad12-a1de27eab915 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:45.485210 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-575c4df3-1a6c-43a5-ad12-a1de27eab915 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1741 microversion: 2.20 time: 0.179045 Jan 17 21:27:45.485757 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 458/910] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:45 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:46.504249 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c8a7fb81-04d8-478f-918a-1fd450366a29 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:46.505040 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c8a7fb81-04d8-478f-918a-1fd450366a29 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:46.513501 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c8a7fb81-04d8-478f-918a-1fd450366a29 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:46.514048 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c8a7fb81-04d8-478f-918a-1fd450366a29 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:46.515020 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c8a7fb81-04d8-478f-918a-1fd450366a29 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:46.515670 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c8a7fb81-04d8-478f-918a-1fd450366a29 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:46.670572 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-c8a7fb81-04d8-478f-918a-1fd450366a29 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:46.679030 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-c8a7fb81-04d8-478f-918a-1fd450366a29 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:46.683588 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-c8a7fb81-04d8-478f-918a-1fd450366a29 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:46.683588 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c8a7fb81-04d8-478f-918a-1fd450366a29 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1741 microversion: 2.20 time: 0.182424 Jan 17 21:27:46.683588 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 453/911] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:46 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:47.701947 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-bc750337-dffc-4df7-b1b5-08c1a2752a0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:47.702697 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-bc750337-dffc-4df7-b1b5-08c1a2752a0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:47.710226 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bc750337-dffc-4df7-b1b5-08c1a2752a0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:47.710654 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bc750337-dffc-4df7-b1b5-08c1a2752a0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:47.711459 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bc750337-dffc-4df7-b1b5-08c1a2752a0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:47.711894 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bc750337-dffc-4df7-b1b5-08c1a2752a0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:47.874255 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-bc750337-dffc-4df7-b1b5-08c1a2752a0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:47.883599 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-bc750337-dffc-4df7-b1b5-08c1a2752a0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:47.885248 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-bc750337-dffc-4df7-b1b5-08c1a2752a0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:47.887007 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-bc750337-dffc-4df7-b1b5-08c1a2752a0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1741 microversion: 2.20 time: 0.189819 Jan 17 21:27:47.887867 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 459/912] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:47 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:48.905495 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ebc28d84-b33a-4254-9330-bc275d2869e9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:48.906225 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ebc28d84-b33a-4254-9330-bc275d2869e9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:48.916158 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebc28d84-b33a-4254-9330-bc275d2869e9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:48.916663 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebc28d84-b33a-4254-9330-bc275d2869e9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:48.918064 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebc28d84-b33a-4254-9330-bc275d2869e9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:48.918512 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebc28d84-b33a-4254-9330-bc275d2869e9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:49.071483 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ebc28d84-b33a-4254-9330-bc275d2869e9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:49.080196 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ebc28d84-b33a-4254-9330-bc275d2869e9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:49.082957 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ebc28d84-b33a-4254-9330-bc275d2869e9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:49.090318 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ebc28d84-b33a-4254-9330-bc275d2869e9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1741 microversion: 2.20 time: 0.189152 Jan 17 21:27:49.106146 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 454/913] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:48 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:50.117884 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-983083a9-d2d4-4f5d-906a-0f723351dc73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:50.118664 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-983083a9-d2d4-4f5d-906a-0f723351dc73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:50.130866 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-983083a9-d2d4-4f5d-906a-0f723351dc73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:50.131334 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-983083a9-d2d4-4f5d-906a-0f723351dc73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:50.132153 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-983083a9-d2d4-4f5d-906a-0f723351dc73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:50.132648 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-983083a9-d2d4-4f5d-906a-0f723351dc73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:50.301569 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-983083a9-d2d4-4f5d-906a-0f723351dc73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:50.310903 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-983083a9-d2d4-4f5d-906a-0f723351dc73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:50.312472 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-983083a9-d2d4-4f5d-906a-0f723351dc73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:50.313637 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-983083a9-d2d4-4f5d-906a-0f723351dc73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1741 microversion: 2.20 time: 0.202399 Jan 17 21:27:50.325103 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 460/914] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:50 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1741 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:51.332675 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8234031d-28c2-4313-9844-e4209625fa7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:51.333233 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8234031d-28c2-4313-9844-e4209625fa7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:51.339939 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8234031d-28c2-4313-9844-e4209625fa7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:51.340442 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8234031d-28c2-4313-9844-e4209625fa7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:51.341234 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8234031d-28c2-4313-9844-e4209625fa7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:51.341666 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8234031d-28c2-4313-9844-e4209625fa7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:51.478581 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8234031d-28c2-4313-9844-e4209625fa7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:51.487186 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8234031d-28c2-4313-9844-e4209625fa7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:51.488717 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8234031d-28c2-4313-9844-e4209625fa7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:51.489892 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8234031d-28c2-4313-9844-e4209625fa7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1741 microversion: 2.20 time: 0.161018 Jan 17 21:27:51.490436 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 455/915] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:51 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:52.508778 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f65ff37c-0266-4eda-b4c7-c2551998e273 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:52.509452 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f65ff37c-0266-4eda-b4c7-c2551998e273 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:52.515477 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f65ff37c-0266-4eda-b4c7-c2551998e273 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:52.515939 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f65ff37c-0266-4eda-b4c7-c2551998e273 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:52.516768 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f65ff37c-0266-4eda-b4c7-c2551998e273 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:52.517218 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f65ff37c-0266-4eda-b4c7-c2551998e273 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:52.654460 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f65ff37c-0266-4eda-b4c7-c2551998e273 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:52.662509 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f65ff37c-0266-4eda-b4c7-c2551998e273 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:52.664145 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f65ff37c-0266-4eda-b4c7-c2551998e273 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:52.665361 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f65ff37c-0266-4eda-b4c7-c2551998e273 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1723 microversion: 2.20 time: 0.160326 Jan 17 21:27:52.666002 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 461/916] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:52 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:53.685407 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-daf12044-d068-45e1-acc9-7472e89b7be4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:53.686013 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-daf12044-d068-45e1-acc9-7472e89b7be4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:53.692501 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-daf12044-d068-45e1-acc9-7472e89b7be4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:53.692954 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-daf12044-d068-45e1-acc9-7472e89b7be4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:53.693742 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-daf12044-d068-45e1-acc9-7472e89b7be4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:53.694210 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-daf12044-d068-45e1-acc9-7472e89b7be4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:53.842277 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-daf12044-d068-45e1-acc9-7472e89b7be4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:53.851859 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-daf12044-d068-45e1-acc9-7472e89b7be4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:53.853369 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-daf12044-d068-45e1-acc9-7472e89b7be4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:53.855031 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-daf12044-d068-45e1-acc9-7472e89b7be4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1723 microversion: 2.20 time: 0.173926 Jan 17 21:27:53.855585 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 456/917] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:53 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:54.873859 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-be3a7579-e871-4d7e-bbdb-4ddb62feea76 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:54.874429 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-be3a7579-e871-4d7e-bbdb-4ddb62feea76 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:54.882243 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-be3a7579-e871-4d7e-bbdb-4ddb62feea76 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:54.882702 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-be3a7579-e871-4d7e-bbdb-4ddb62feea76 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:54.883642 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-be3a7579-e871-4d7e-bbdb-4ddb62feea76 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:54.884108 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-be3a7579-e871-4d7e-bbdb-4ddb62feea76 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:55.024846 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-be3a7579-e871-4d7e-bbdb-4ddb62feea76 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:55.033123 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-be3a7579-e871-4d7e-bbdb-4ddb62feea76 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:55.034619 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-be3a7579-e871-4d7e-bbdb-4ddb62feea76 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:55.035762 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-be3a7579-e871-4d7e-bbdb-4ddb62feea76 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1666 microversion: 2.20 time: 0.166173 Jan 17 21:27:55.036324 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 462/918] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:54 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1666 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:55.053452 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ecba0007-16ab-4465-913c-be6c77bb8095 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d58140de-6193-45f2-8972-725304e49827"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:55.054762 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ecba0007-16ab-4465-913c-be6c77bb8095 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:55.062203 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ecba0007-16ab-4465-913c-be6c77bb8095 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:55.062652 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ecba0007-16ab-4465-913c-be6c77bb8095 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:55.063474 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ecba0007-16ab-4465-913c-be6c77bb8095 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:55.064256 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ecba0007-16ab-4465-913c-be6c77bb8095 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:55.344744 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ecba0007-16ab-4465-913c-be6c77bb8095 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295067 Jan 17 21:27:55.345396 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 457/919] 10.222.0.64 () {62 vars in 1363 bytes} [Mon Jan 17 21:27:55 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:27:55.456406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6cbd8357-9ece-4572-91ad-dde2effefffb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:55.456999 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6cbd8357-9ece-4572-91ad-dde2effefffb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:55.463302 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6cbd8357-9ece-4572-91ad-dde2effefffb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:55.463767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6cbd8357-9ece-4572-91ad-dde2effefffb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:55.464618 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6cbd8357-9ece-4572-91ad-dde2effefffb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:55.465051 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6cbd8357-9ece-4572-91ad-dde2effefffb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:55.555257 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6cbd8357-9ece-4572-91ad-dde2effefffb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action" status: 202 len: 0 microversion: 2.20 time: 0.102606 Jan 17 21:27:55.556070 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 463/920] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:27:55 2022] POST /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 17 21:27:55.563943 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3ab9db12-f0d1-4727-98f7-4a7bd6fe1a31 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:55.564705 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3ab9db12-f0d1-4727-98f7-4a7bd6fe1a31 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:55.571290 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3ab9db12-f0d1-4727-98f7-4a7bd6fe1a31 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:55.571749 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3ab9db12-f0d1-4727-98f7-4a7bd6fe1a31 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:55.572687 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3ab9db12-f0d1-4727-98f7-4a7bd6fe1a31 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:55.573112 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3ab9db12-f0d1-4727-98f7-4a7bd6fe1a31 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:55.715164 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3ab9db12-f0d1-4727-98f7-4a7bd6fe1a31 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:55.723331 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3ab9db12-f0d1-4727-98f7-4a7bd6fe1a31 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:55.724849 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3ab9db12-f0d1-4727-98f7-4a7bd6fe1a31 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:55.725999 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3ab9db12-f0d1-4727-98f7-4a7bd6fe1a31 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1752 microversion: 2.20 time: 0.165896 Jan 17 21:27:55.726546 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 458/921] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:55 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:56.169769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-54faacf3-aa2a-4437-96b9-dae444843b3d req-85ed150b-85ab-41a4-ae2a-28c33b1c6cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5edb3c99-d30d-4a2c-8b50-5083b7ea9d96", "name": "network-vif-unplugged", "status": "completed", "tag": "dde4fe76-f1d0-4978-a642-2a35761fdf74"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:27:56.171368 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:27:56.171368 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:27:56.180035 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-54faacf3-aa2a-4437-96b9-dae444843b3d req-85ed150b-85ab-41a4-ae2a-28c33b1c6cf0 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:56.180505 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-54faacf3-aa2a-4437-96b9-dae444843b3d req-85ed150b-85ab-41a4-ae2a-28c33b1c6cf0 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:56.193089 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.compute.server_external_events [req-54faacf3-aa2a-4437-96b9-dae444843b3d req-85ed150b-85ab-41a4-ae2a-28c33b1c6cf0 service nova] Unable to find a host for instance 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96. Dropping event network-vif-unplugged {{(pid=116182) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 17 21:27:56.193984 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-54faacf3-aa2a-4437-96b9-dae444843b3d req-85ed150b-85ab-41a4-ae2a-28c33b1c6cf0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028697 Jan 17 21:27:56.194734 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 464/922] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 17 21:27:56.745428 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-877456a4-8c9e-4940-953a-1cb6a33506fd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:56.746048 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-877456a4-8c9e-4940-953a-1cb6a33506fd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:56.753046 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-877456a4-8c9e-4940-953a-1cb6a33506fd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:56.753506 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-877456a4-8c9e-4940-953a-1cb6a33506fd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:56.754315 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-877456a4-8c9e-4940-953a-1cb6a33506fd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:56.754763 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-877456a4-8c9e-4940-953a-1cb6a33506fd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:56.890264 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-877456a4-8c9e-4940-953a-1cb6a33506fd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:56.899632 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-877456a4-8c9e-4940-953a-1cb6a33506fd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:56.901390 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-877456a4-8c9e-4940-953a-1cb6a33506fd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:56.902711 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-877456a4-8c9e-4940-953a-1cb6a33506fd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1754 microversion: 2.20 time: 0.161633 Jan 17 21:27:56.903271 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 459/923] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:56 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:57.922361 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3ee53c11-f192-42bd-9521-d21f398fbc3c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:57.923080 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-3ee53c11-f192-42bd-9521-d21f398fbc3c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:57.930036 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ee53c11-f192-42bd-9521-d21f398fbc3c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:57.930505 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ee53c11-f192-42bd-9521-d21f398fbc3c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:57.931309 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ee53c11-f192-42bd-9521-d21f398fbc3c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:57.931772 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ee53c11-f192-42bd-9521-d21f398fbc3c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:58.074959 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-3ee53c11-f192-42bd-9521-d21f398fbc3c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:58.083363 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-3ee53c11-f192-42bd-9521-d21f398fbc3c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:58.085205 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-3ee53c11-f192-42bd-9521-d21f398fbc3c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:58.086363 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3ee53c11-f192-42bd-9521-d21f398fbc3c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.168105 Jan 17 21:27:58.086922 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 465/924] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:57 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:27:59.105922 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-39bd27ac-22cf-4ceb-97bb-8ca4180eb729 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:27:59.106538 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-39bd27ac-22cf-4ceb-97bb-8ca4180eb729 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:27:59.113424 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-39bd27ac-22cf-4ceb-97bb-8ca4180eb729 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:59.113883 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-39bd27ac-22cf-4ceb-97bb-8ca4180eb729 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:59.114700 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-39bd27ac-22cf-4ceb-97bb-8ca4180eb729 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:27:59.115138 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-39bd27ac-22cf-4ceb-97bb-8ca4180eb729 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:27:59.257953 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-39bd27ac-22cf-4ceb-97bb-8ca4180eb729 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:59.267294 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-39bd27ac-22cf-4ceb-97bb-8ca4180eb729 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:59.268871 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-39bd27ac-22cf-4ceb-97bb-8ca4180eb729 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:27:59.270057 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-39bd27ac-22cf-4ceb-97bb-8ca4180eb729 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.168403 Jan 17 21:27:59.270795 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 460/925] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:27:59 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:00.289225 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4c25ad6c-e7af-4470-88ea-b2c26a73a7a0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:00.289225 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4c25ad6c-e7af-4470-88ea-b2c26a73a7a0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:00.297555 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c25ad6c-e7af-4470-88ea-b2c26a73a7a0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:00.298234 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c25ad6c-e7af-4470-88ea-b2c26a73a7a0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:00.299044 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c25ad6c-e7af-4470-88ea-b2c26a73a7a0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:00.299721 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c25ad6c-e7af-4470-88ea-b2c26a73a7a0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:00.457417 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4c25ad6c-e7af-4470-88ea-b2c26a73a7a0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:00.468447 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4c25ad6c-e7af-4470-88ea-b2c26a73a7a0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:00.470316 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4c25ad6c-e7af-4470-88ea-b2c26a73a7a0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:00.471624 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4c25ad6c-e7af-4470-88ea-b2c26a73a7a0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.186876 Jan 17 21:28:00.472197 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 466/926] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:00 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:01.489852 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2a6cb5a3-5eff-4543-99c5-d715f10d388a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:01.490485 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2a6cb5a3-5eff-4543-99c5-d715f10d388a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:01.500487 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a6cb5a3-5eff-4543-99c5-d715f10d388a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:01.500487 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a6cb5a3-5eff-4543-99c5-d715f10d388a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:01.500487 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a6cb5a3-5eff-4543-99c5-d715f10d388a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:01.500487 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a6cb5a3-5eff-4543-99c5-d715f10d388a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:01.640795 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2a6cb5a3-5eff-4543-99c5-d715f10d388a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:01.649844 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2a6cb5a3-5eff-4543-99c5-d715f10d388a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:01.652113 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2a6cb5a3-5eff-4543-99c5-d715f10d388a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:01.653589 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2a6cb5a3-5eff-4543-99c5-d715f10d388a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.167360 Jan 17 21:28:01.654432 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 461/927] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:01 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:02.673557 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d2dc2a18-437e-443b-b11b-a29deecc27c2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:02.674928 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d2dc2a18-437e-443b-b11b-a29deecc27c2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:02.682624 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d2dc2a18-437e-443b-b11b-a29deecc27c2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:02.683082 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d2dc2a18-437e-443b-b11b-a29deecc27c2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:02.683943 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d2dc2a18-437e-443b-b11b-a29deecc27c2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:02.684400 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d2dc2a18-437e-443b-b11b-a29deecc27c2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:02.849417 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d2dc2a18-437e-443b-b11b-a29deecc27c2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:02.859778 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d2dc2a18-437e-443b-b11b-a29deecc27c2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:02.861499 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d2dc2a18-437e-443b-b11b-a29deecc27c2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:02.862918 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d2dc2a18-437e-443b-b11b-a29deecc27c2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.193564 Jan 17 21:28:02.863621 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 467/928] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:02 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:03.882174 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-486bedd0-caa1-4119-8874-77a8364b4ed1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:03.882845 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-486bedd0-caa1-4119-8874-77a8364b4ed1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:03.889662 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-486bedd0-caa1-4119-8874-77a8364b4ed1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:03.890119 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-486bedd0-caa1-4119-8874-77a8364b4ed1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:03.890919 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-486bedd0-caa1-4119-8874-77a8364b4ed1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:03.891360 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-486bedd0-caa1-4119-8874-77a8364b4ed1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:04.037166 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-486bedd0-caa1-4119-8874-77a8364b4ed1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:04.045707 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-486bedd0-caa1-4119-8874-77a8364b4ed1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:04.047214 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-486bedd0-caa1-4119-8874-77a8364b4ed1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:04.048444 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-486bedd0-caa1-4119-8874-77a8364b4ed1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.170183 Jan 17 21:28:04.049149 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 462/929] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:03 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:05.066906 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f2e78eba-14c1-492b-9d31-78dc48206bdb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:05.067593 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f2e78eba-14c1-492b-9d31-78dc48206bdb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:05.077474 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f2e78eba-14c1-492b-9d31-78dc48206bdb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:05.077936 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f2e78eba-14c1-492b-9d31-78dc48206bdb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:05.078749 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f2e78eba-14c1-492b-9d31-78dc48206bdb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:05.079194 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f2e78eba-14c1-492b-9d31-78dc48206bdb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:05.229705 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f2e78eba-14c1-492b-9d31-78dc48206bdb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:05.239886 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f2e78eba-14c1-492b-9d31-78dc48206bdb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:05.241452 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f2e78eba-14c1-492b-9d31-78dc48206bdb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:05.242751 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f2e78eba-14c1-492b-9d31-78dc48206bdb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.179623 Jan 17 21:28:05.243392 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 468/930] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:05 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:06.262031 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1764db34-2a69-4314-8617-4a37d8e6025a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:06.262619 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1764db34-2a69-4314-8617-4a37d8e6025a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:06.269185 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1764db34-2a69-4314-8617-4a37d8e6025a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:06.269636 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1764db34-2a69-4314-8617-4a37d8e6025a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:06.270434 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1764db34-2a69-4314-8617-4a37d8e6025a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:06.270867 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1764db34-2a69-4314-8617-4a37d8e6025a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:06.428876 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1764db34-2a69-4314-8617-4a37d8e6025a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:06.438017 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1764db34-2a69-4314-8617-4a37d8e6025a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:06.439529 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1764db34-2a69-4314-8617-4a37d8e6025a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:06.440701 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1764db34-2a69-4314-8617-4a37d8e6025a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.183093 Jan 17 21:28:06.441357 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 463/931] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:06 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:07.459482 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7b876aa3-5fe6-4a77-9400-0dd2448c9830 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:07.460104 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7b876aa3-5fe6-4a77-9400-0dd2448c9830 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:07.466658 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7b876aa3-5fe6-4a77-9400-0dd2448c9830 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:07.467128 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7b876aa3-5fe6-4a77-9400-0dd2448c9830 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:07.467935 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7b876aa3-5fe6-4a77-9400-0dd2448c9830 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:07.468396 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7b876aa3-5fe6-4a77-9400-0dd2448c9830 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:07.614672 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7b876aa3-5fe6-4a77-9400-0dd2448c9830 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:07.623387 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7b876aa3-5fe6-4a77-9400-0dd2448c9830 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:07.624892 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7b876aa3-5fe6-4a77-9400-0dd2448c9830 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:07.626049 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7b876aa3-5fe6-4a77-9400-0dd2448c9830 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.170707 Jan 17 21:28:07.626616 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 469/932] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:07 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:08.643740 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f4f7cde1-2564-4a94-a449-fa3442d4a53a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:08.644425 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f4f7cde1-2564-4a94-a449-fa3442d4a53a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:08.650786 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f4f7cde1-2564-4a94-a449-fa3442d4a53a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:08.651241 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f4f7cde1-2564-4a94-a449-fa3442d4a53a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:08.652040 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f4f7cde1-2564-4a94-a449-fa3442d4a53a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:08.652514 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f4f7cde1-2564-4a94-a449-fa3442d4a53a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:08.795306 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-f4f7cde1-2564-4a94-a449-fa3442d4a53a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:08.804125 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-f4f7cde1-2564-4a94-a449-fa3442d4a53a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:08.805661 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-f4f7cde1-2564-4a94-a449-fa3442d4a53a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:08.807458 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f4f7cde1-2564-4a94-a449-fa3442d4a53a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.166740 Jan 17 21:28:08.808014 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 464/933] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:08 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:28:09.826299 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8c1e0f6a-937b-4dc3-b9b3-ef648a29a15c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:09.826951 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8c1e0f6a-937b-4dc3-b9b3-ef648a29a15c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:09.833919 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8c1e0f6a-937b-4dc3-b9b3-ef648a29a15c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:09.834374 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8c1e0f6a-937b-4dc3-b9b3-ef648a29a15c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:09.835164 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8c1e0f6a-937b-4dc3-b9b3-ef648a29a15c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:09.835608 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8c1e0f6a-937b-4dc3-b9b3-ef648a29a15c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:09.968869 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-8c1e0f6a-937b-4dc3-b9b3-ef648a29a15c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:09.977340 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-8c1e0f6a-937b-4dc3-b9b3-ef648a29a15c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:09.978891 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-8c1e0f6a-937b-4dc3-b9b3-ef648a29a15c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:09.980079 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8c1e0f6a-937b-4dc3-b9b3-ef648a29a15c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.158118 Jan 17 21:28:09.980889 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 470/934] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:09 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:10.998155 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9c02864c-1dee-4d2f-ba6e-228b50c71629 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:10.998755 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-9c02864c-1dee-4d2f-ba6e-228b50c71629 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:11.005193 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9c02864c-1dee-4d2f-ba6e-228b50c71629 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:11.005652 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9c02864c-1dee-4d2f-ba6e-228b50c71629 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:11.006449 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9c02864c-1dee-4d2f-ba6e-228b50c71629 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:11.006891 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9c02864c-1dee-4d2f-ba6e-228b50c71629 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:11.141267 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-9c02864c-1dee-4d2f-ba6e-228b50c71629 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:11.149606 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-9c02864c-1dee-4d2f-ba6e-228b50c71629 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:11.151667 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-9c02864c-1dee-4d2f-ba6e-228b50c71629 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:11.152852 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-9c02864c-1dee-4d2f-ba6e-228b50c71629 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.158362 Jan 17 21:28:11.153414 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 465/935] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:10 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:12.170841 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f905f021-e127-46b7-98fa-22c29232b67a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:12.171432 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f905f021-e127-46b7-98fa-22c29232b67a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:12.177745 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f905f021-e127-46b7-98fa-22c29232b67a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:12.178201 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f905f021-e127-46b7-98fa-22c29232b67a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:12.178978 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f905f021-e127-46b7-98fa-22c29232b67a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:12.179419 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f905f021-e127-46b7-98fa-22c29232b67a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:12.538026 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f905f021-e127-46b7-98fa-22c29232b67a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:12.546216 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f905f021-e127-46b7-98fa-22c29232b67a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:12.547713 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f905f021-e127-46b7-98fa-22c29232b67a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:12.548994 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f905f021-e127-46b7-98fa-22c29232b67a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.381828 Jan 17 21:28:12.549532 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 471/936] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:12 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:13.567112 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ff17520d-0bde-42bc-8180-2bd2b5bfadc0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:13.567709 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ff17520d-0bde-42bc-8180-2bd2b5bfadc0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:13.573994 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ff17520d-0bde-42bc-8180-2bd2b5bfadc0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:13.574452 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ff17520d-0bde-42bc-8180-2bd2b5bfadc0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:13.575234 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ff17520d-0bde-42bc-8180-2bd2b5bfadc0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:13.575676 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ff17520d-0bde-42bc-8180-2bd2b5bfadc0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:13.702993 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ff17520d-0bde-42bc-8180-2bd2b5bfadc0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:13.711479 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ff17520d-0bde-42bc-8180-2bd2b5bfadc0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:13.713535 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ff17520d-0bde-42bc-8180-2bd2b5bfadc0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:13.714689 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ff17520d-0bde-42bc-8180-2bd2b5bfadc0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.151348 Jan 17 21:28:13.715245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 466/937] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:13 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:14.732108 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-288e3d3b-7460-420c-a77b-8a513c92f36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:14.732745 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-288e3d3b-7460-420c-a77b-8a513c92f36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:14.739048 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-288e3d3b-7460-420c-a77b-8a513c92f36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:14.739752 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-288e3d3b-7460-420c-a77b-8a513c92f36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:14.740589 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-288e3d3b-7460-420c-a77b-8a513c92f36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:14.741034 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-288e3d3b-7460-420c-a77b-8a513c92f36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:14.882028 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-288e3d3b-7460-420c-a77b-8a513c92f36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:14.891969 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-288e3d3b-7460-420c-a77b-8a513c92f36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:14.893484 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-288e3d3b-7460-420c-a77b-8a513c92f36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:14.894656 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-288e3d3b-7460-420c-a77b-8a513c92f36f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.166251 Jan 17 21:28:14.895202 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 472/938] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:14 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:28:15.913213 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-864438d9-4743-4273-b875-6beec78651bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:15.913813 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-864438d9-4743-4273-b875-6beec78651bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:15.920716 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-864438d9-4743-4273-b875-6beec78651bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:15.921167 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-864438d9-4743-4273-b875-6beec78651bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:15.921941 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-864438d9-4743-4273-b875-6beec78651bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:15.922380 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-864438d9-4743-4273-b875-6beec78651bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:16.050159 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-864438d9-4743-4273-b875-6beec78651bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:16.058782 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-864438d9-4743-4273-b875-6beec78651bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:16.060275 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-864438d9-4743-4273-b875-6beec78651bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:16.061462 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-864438d9-4743-4273-b875-6beec78651bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.151977 Jan 17 21:28:16.062025 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 467/939] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:15 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:17.079187 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c77bfac4-f351-453b-9574-fcf827388be2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:17.079794 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c77bfac4-f351-453b-9574-fcf827388be2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:17.088039 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c77bfac4-f351-453b-9574-fcf827388be2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:17.088542 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c77bfac4-f351-453b-9574-fcf827388be2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:17.089509 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c77bfac4-f351-453b-9574-fcf827388be2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:17.089966 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c77bfac4-f351-453b-9574-fcf827388be2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:17.224860 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c77bfac4-f351-453b-9574-fcf827388be2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:17.232993 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c77bfac4-f351-453b-9574-fcf827388be2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:17.234559 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c77bfac4-f351-453b-9574-fcf827388be2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:17.235624 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c77bfac4-f351-453b-9574-fcf827388be2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.160402 Jan 17 21:28:17.236177 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 473/940] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:17 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:28:18.254360 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f4306c8d-67a0-47d8-871c-41106892e091 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:18.254908 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f4306c8d-67a0-47d8-871c-41106892e091 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:18.261088 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f4306c8d-67a0-47d8-871c-41106892e091 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:18.261539 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f4306c8d-67a0-47d8-871c-41106892e091 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:18.262315 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f4306c8d-67a0-47d8-871c-41106892e091 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:18.262754 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f4306c8d-67a0-47d8-871c-41106892e091 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:18.389016 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-f4306c8d-67a0-47d8-871c-41106892e091 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:18.397095 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-f4306c8d-67a0-47d8-871c-41106892e091 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:18.398577 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-f4306c8d-67a0-47d8-871c-41106892e091 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:18.399715 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f4306c8d-67a0-47d8-871c-41106892e091 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.149120 Jan 17 21:28:18.400919 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 468/941] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:18 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:19.419022 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-856baaa2-3a45-4f7c-bf78-10a698e18242 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:19.419618 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-856baaa2-3a45-4f7c-bf78-10a698e18242 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:19.426006 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-856baaa2-3a45-4f7c-bf78-10a698e18242 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:19.426485 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-856baaa2-3a45-4f7c-bf78-10a698e18242 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:19.427283 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-856baaa2-3a45-4f7c-bf78-10a698e18242 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:19.427727 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-856baaa2-3a45-4f7c-bf78-10a698e18242 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:19.561345 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-856baaa2-3a45-4f7c-bf78-10a698e18242 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:19.569675 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-856baaa2-3a45-4f7c-bf78-10a698e18242 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:19.571153 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-856baaa2-3a45-4f7c-bf78-10a698e18242 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:19.572290 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-856baaa2-3a45-4f7c-bf78-10a698e18242 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.157562 Jan 17 21:28:19.572897 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 474/942] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:19 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:20.590275 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8c1321b8-c898-4c4f-b4b3-9177b44da269 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:20.590831 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8c1321b8-c898-4c4f-b4b3-9177b44da269 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:20.597328 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8c1321b8-c898-4c4f-b4b3-9177b44da269 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:20.597788 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8c1321b8-c898-4c4f-b4b3-9177b44da269 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:20.598580 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8c1321b8-c898-4c4f-b4b3-9177b44da269 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:20.599052 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8c1321b8-c898-4c4f-b4b3-9177b44da269 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:20.733691 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8c1321b8-c898-4c4f-b4b3-9177b44da269 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:20.741884 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8c1321b8-c898-4c4f-b4b3-9177b44da269 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:20.743373 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8c1321b8-c898-4c4f-b4b3-9177b44da269 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:20.745158 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8c1321b8-c898-4c4f-b4b3-9177b44da269 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.158972 Jan 17 21:28:20.745742 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 469/943] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:20 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:21.762981 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a50cbc5d-810f-4e15-b780-1f9dda5ccb4e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:21.763572 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a50cbc5d-810f-4e15-b780-1f9dda5ccb4e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:21.769965 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a50cbc5d-810f-4e15-b780-1f9dda5ccb4e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:21.770418 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a50cbc5d-810f-4e15-b780-1f9dda5ccb4e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:21.771214 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a50cbc5d-810f-4e15-b780-1f9dda5ccb4e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:21.771661 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a50cbc5d-810f-4e15-b780-1f9dda5ccb4e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:21.903084 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a50cbc5d-810f-4e15-b780-1f9dda5ccb4e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:21.911801 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a50cbc5d-810f-4e15-b780-1f9dda5ccb4e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:21.913315 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a50cbc5d-810f-4e15-b780-1f9dda5ccb4e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:21.914461 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a50cbc5d-810f-4e15-b780-1f9dda5ccb4e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.155218 Jan 17 21:28:21.915016 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 475/944] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:21 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:22.310635 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-fa3ae0f4-8d53-446c-87f7-3efc8c845f11 req-83f5bf0a-e188-46c3-b56b-ec290f55d4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5edb3c99-d30d-4a2c-8b50-5083b7ea9d96", "name": "network-vif-plugged", "status": "completed", "tag": "dde4fe76-f1d0-4978-a642-2a35761fdf74"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:28:22.312277 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:28:22.312277 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:28:22.320170 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-fa3ae0f4-8d53-446c-87f7-3efc8c845f11 req-83f5bf0a-e188-46c3-b56b-ec290f55d4b1 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:22.320667 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-fa3ae0f4-8d53-446c-87f7-3efc8c845f11 req-83f5bf0a-e188-46c3-b56b-ec290f55d4b1 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:22.333192 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-fa3ae0f4-8d53-446c-87f7-3efc8c845f11 req-83f5bf0a-e188-46c3-b56b-ec290f55d4b1 service nova] Creating event network-vif-plugged:dde4fe76-f1d0-4978-a642-2a35761fdf74 for instance 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 on hv-cinder-82489 Jan 17 21:28:22.338426 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-fa3ae0f4-8d53-446c-87f7-3efc8c845f11 req-83f5bf0a-e188-46c3-b56b-ec290f55d4b1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031973 Jan 17 21:28:22.339018 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 470/945] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:28:22.934451 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-409e659e-ecf1-4688-aac0-6a17851ec97e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:22.935061 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-409e659e-ecf1-4688-aac0-6a17851ec97e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:22.941108 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-409e659e-ecf1-4688-aac0-6a17851ec97e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:22.941568 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-409e659e-ecf1-4688-aac0-6a17851ec97e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:22.942392 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-409e659e-ecf1-4688-aac0-6a17851ec97e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:22.942837 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-409e659e-ecf1-4688-aac0-6a17851ec97e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:23.081667 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-409e659e-ecf1-4688-aac0-6a17851ec97e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:23.098014 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-409e659e-ecf1-4688-aac0-6a17851ec97e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:23.099594 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-409e659e-ecf1-4688-aac0-6a17851ec97e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:23.100817 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-409e659e-ecf1-4688-aac0-6a17851ec97e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.171290 Jan 17 21:28:23.101377 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 476/946] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:22 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:24.119970 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-097c6197-9813-4f1e-a702-cd1837ec39cf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:24.120698 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-097c6197-9813-4f1e-a702-cd1837ec39cf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:24.126879 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-097c6197-9813-4f1e-a702-cd1837ec39cf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:24.127339 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-097c6197-9813-4f1e-a702-cd1837ec39cf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:24.128125 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-097c6197-9813-4f1e-a702-cd1837ec39cf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:24.128605 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-097c6197-9813-4f1e-a702-cd1837ec39cf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:24.259176 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-097c6197-9813-4f1e-a702-cd1837ec39cf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:24.267813 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-097c6197-9813-4f1e-a702-cd1837ec39cf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:24.270198 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-097c6197-9813-4f1e-a702-cd1837ec39cf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:24.270973 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-097c6197-9813-4f1e-a702-cd1837ec39cf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1810 microversion: 2.20 time: 0.155096 Jan 17 21:28:24.272412 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 471/947] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:24 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:25.288270 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-324e5e46-d73b-45f4-9cc4-4ba99a4f08e7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:25.288900 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-324e5e46-d73b-45f4-9cc4-4ba99a4f08e7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:25.295829 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-324e5e46-d73b-45f4-9cc4-4ba99a4f08e7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:25.296276 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-324e5e46-d73b-45f4-9cc4-4ba99a4f08e7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:25.297511 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-324e5e46-d73b-45f4-9cc4-4ba99a4f08e7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:25.297949 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-324e5e46-d73b-45f4-9cc4-4ba99a4f08e7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:25.428980 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-324e5e46-d73b-45f4-9cc4-4ba99a4f08e7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:25.438056 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-324e5e46-d73b-45f4-9cc4-4ba99a4f08e7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:25.439568 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-324e5e46-d73b-45f4-9cc4-4ba99a4f08e7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:25.440768 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-324e5e46-d73b-45f4-9cc4-4ba99a4f08e7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1797 microversion: 2.20 time: 0.156128 Jan 17 21:28:25.441334 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 477/948] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:28:25 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1797 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:28:42.382971 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6680af4d-db11-48c2-88bb-3be27b6dc72b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:28:42.383583 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6680af4d-db11-48c2-88bb-3be27b6dc72b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:42.389662 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6680af4d-db11-48c2-88bb-3be27b6dc72b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:42.390162 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6680af4d-db11-48c2-88bb-3be27b6dc72b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:42.390997 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6680af4d-db11-48c2-88bb-3be27b6dc72b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:42.391438 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6680af4d-db11-48c2-88bb-3be27b6dc72b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:42.415647 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.objects.instance [None req-6680af4d-db11-48c2-88bb-3be27b6dc72b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lazy-loading 'flavor' on Instance uuid 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 {{(pid=116183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:28:42.490474 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6680af4d-db11-48c2-88bb-3be27b6dc72b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "POST /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8/action" status: 202 len: 0 microversion: 2.1 time: 0.110984 Jan 17 21:28:42.491154 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 472/949] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:28:42 2022] POST /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:28:42.499933 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-610159af-7be9-4904-b707-0188c99bcfd4 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:42.500575 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-610159af-7be9-4904-b707-0188c99bcfd4 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:42.507173 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-610159af-7be9-4904-b707-0188c99bcfd4 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:42.507627 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-610159af-7be9-4904-b707-0188c99bcfd4 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:42.508543 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-610159af-7be9-4904-b707-0188c99bcfd4 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:42.508992 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-610159af-7be9-4904-b707-0188c99bcfd4 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:42.648585 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-610159af-7be9-4904-b707-0188c99bcfd4 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:42.656285 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-610159af-7be9-4904-b707-0188c99bcfd4 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1569 microversion: 2.1 time: 0.159909 Jan 17 21:28:42.656914 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 478/950] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:42 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:43.675365 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9ef44e99-b814-4a07-b6a9-fce59ef34873 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:43.676745 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-9ef44e99-b814-4a07-b6a9-fce59ef34873 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:43.682788 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9ef44e99-b814-4a07-b6a9-fce59ef34873 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:43.683248 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9ef44e99-b814-4a07-b6a9-fce59ef34873 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:43.684055 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9ef44e99-b814-4a07-b6a9-fce59ef34873 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:43.684553 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9ef44e99-b814-4a07-b6a9-fce59ef34873 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:43.821023 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-9ef44e99-b814-4a07-b6a9-fce59ef34873 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:43.829416 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-9ef44e99-b814-4a07-b6a9-fce59ef34873 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1569 microversion: 2.1 time: 0.158664 Jan 17 21:28:43.830000 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 473/951] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:43 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:44.846924 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b90e123e-652c-4442-b5da-464ebbe327ab tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:44.847566 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b90e123e-652c-4442-b5da-464ebbe327ab tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:44.854126 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b90e123e-652c-4442-b5da-464ebbe327ab tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:44.854586 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b90e123e-652c-4442-b5da-464ebbe327ab tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:44.855388 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b90e123e-652c-4442-b5da-464ebbe327ab tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:44.855938 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b90e123e-652c-4442-b5da-464ebbe327ab tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:44.999758 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b90e123e-652c-4442-b5da-464ebbe327ab tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:45.009273 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b90e123e-652c-4442-b5da-464ebbe327ab tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1569 microversion: 2.1 time: 0.165305 Jan 17 21:28:45.009869 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 479/952] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:44 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:45.060925 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4d35fe54-f6ae-462b-a174-888c9f880aa4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:45.061699 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4d35fe54-f6ae-462b-a174-888c9f880aa4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:45.069476 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4d35fe54-f6ae-462b-a174-888c9f880aa4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:45.070047 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4d35fe54-f6ae-462b-a174-888c9f880aa4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:45.071822 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4d35fe54-f6ae-462b-a174-888c9f880aa4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:45.072343 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4d35fe54-f6ae-462b-a174-888c9f880aa4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:45.098820 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4d35fe54-f6ae-462b-a174-888c9f880aa4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Going to try to terminate instance {{(pid=116183) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:28:45.181137 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4d35fe54-f6ae-462b-a174-888c9f880aa4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "DELETE /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 204 len: 0 microversion: 2.1 time: 0.125083 Jan 17 21:28:45.182945 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 474/953] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:28:45 2022] DELETE /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:28:45.190076 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2bceaf92-17c0-4c5c-ae18-e989a3532e1f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:45.190691 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2bceaf92-17c0-4c5c-ae18-e989a3532e1f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:45.199021 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2bceaf92-17c0-4c5c-ae18-e989a3532e1f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:45.199484 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2bceaf92-17c0-4c5c-ae18-e989a3532e1f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:45.200601 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2bceaf92-17c0-4c5c-ae18-e989a3532e1f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:45.201054 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2bceaf92-17c0-4c5c-ae18-e989a3532e1f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:45.347481 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2bceaf92-17c0-4c5c-ae18-e989a3532e1f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:45.355796 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2bceaf92-17c0-4c5c-ae18-e989a3532e1f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1577 microversion: 2.1 time: 0.169302 Jan 17 21:28:45.356410 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 480/954] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:45 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:46.032649 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f891031a-c827-4116-8b5a-fd867f6834ff tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:46.033341 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f891031a-c827-4116-8b5a-fd867f6834ff tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:46.041134 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f891031a-c827-4116-8b5a-fd867f6834ff tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:46.041806 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f891031a-c827-4116-8b5a-fd867f6834ff tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:46.042619 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f891031a-c827-4116-8b5a-fd867f6834ff tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:46.044876 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f891031a-c827-4116-8b5a-fd867f6834ff tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:46.191423 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-f891031a-c827-4116-8b5a-fd867f6834ff tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:46.199688 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f891031a-c827-4116-8b5a-fd867f6834ff tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1569 microversion: 2.1 time: 0.171050 Jan 17 21:28:46.200271 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 475/955] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:46 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:46.374329 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7e57ebf7-38d0-405f-9e94-eb11a4df9c16 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:46.374926 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7e57ebf7-38d0-405f-9e94-eb11a4df9c16 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:46.381510 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7e57ebf7-38d0-405f-9e94-eb11a4df9c16 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:46.381963 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7e57ebf7-38d0-405f-9e94-eb11a4df9c16 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:46.382773 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7e57ebf7-38d0-405f-9e94-eb11a4df9c16 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:46.383220 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7e57ebf7-38d0-405f-9e94-eb11a4df9c16 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:46.530766 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7e57ebf7-38d0-405f-9e94-eb11a4df9c16 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:46.538724 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7e57ebf7-38d0-405f-9e94-eb11a4df9c16 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1577 microversion: 2.1 time: 0.168207 Jan 17 21:28:46.550885 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 481/956] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:46 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:47.340822 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-04ce929d-4745-4b34-81f9-567678152f42 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:47.341722 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-04ce929d-4745-4b34-81f9-567678152f42 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:47.349055 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-04ce929d-4745-4b34-81f9-567678152f42 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:47.350105 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-04ce929d-4745-4b34-81f9-567678152f42 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:47.351963 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-04ce929d-4745-4b34-81f9-567678152f42 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:47.353229 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-04ce929d-4745-4b34-81f9-567678152f42 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:47.528714 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-04ce929d-4745-4b34-81f9-567678152f42 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:47.536698 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-04ce929d-4745-4b34-81f9-567678152f42 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1569 microversion: 2.1 time: 0.323061 Jan 17 21:28:47.537296 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 476/957] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:47 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1569 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:47.559051 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f709f570-eb7e-4f06-982a-02de9dcadf0e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:47.559776 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f709f570-eb7e-4f06-982a-02de9dcadf0e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:47.566762 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f709f570-eb7e-4f06-982a-02de9dcadf0e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:47.567300 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f709f570-eb7e-4f06-982a-02de9dcadf0e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:47.568256 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f709f570-eb7e-4f06-982a-02de9dcadf0e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:47.568800 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f709f570-eb7e-4f06-982a-02de9dcadf0e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:47.732409 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f709f570-eb7e-4f06-982a-02de9dcadf0e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:47.741232 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f709f570-eb7e-4f06-982a-02de9dcadf0e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1577 microversion: 2.1 time: 0.185895 Jan 17 21:28:47.741831 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 482/958] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:47 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:48.434457 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-9161d5ac-fdd6-4ef9-b04c-4129210e1bfc req-9577f261-e009-464c-be75-efcdec37fe85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "851b3dd1-961b-4d23-9594-2a55d4f0f703", "name": "network-vif-deleted", "tag": "bfd59a07-416c-4292-b1be-059ed60c472c"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:28:48.437808 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:28:48.437808 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:28:48.444588 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-9161d5ac-fdd6-4ef9-b04c-4129210e1bfc req-9577f261-e009-464c-be75-efcdec37fe85 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:48.445197 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-9161d5ac-fdd6-4ef9-b04c-4129210e1bfc req-9577f261-e009-464c-be75-efcdec37fe85 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:48.457535 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-9161d5ac-fdd6-4ef9-b04c-4129210e1bfc req-9577f261-e009-464c-be75-efcdec37fe85 service nova] Creating event network-vif-deleted:bfd59a07-416c-4292-b1be-059ed60c472c for instance 851b3dd1-961b-4d23-9594-2a55d4f0f703 on hv-cinder-82489 Jan 17 21:28:48.463879 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-9161d5ac-fdd6-4ef9-b04c-4129210e1bfc req-9577f261-e009-464c-be75-efcdec37fe85 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033558 Jan 17 21:28:48.464924 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 477/959] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:28:48.555179 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5a66d965-c9cd-4af8-80a1-0881da312893 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:48.555878 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5a66d965-c9cd-4af8-80a1-0881da312893 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:48.562643 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a66d965-c9cd-4af8-80a1-0881da312893 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:48.563474 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a66d965-c9cd-4af8-80a1-0881da312893 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:48.563905 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a66d965-c9cd-4af8-80a1-0881da312893 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:48.564352 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a66d965-c9cd-4af8-80a1-0881da312893 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:48.707376 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5a66d965-c9cd-4af8-80a1-0881da312893 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:48.715383 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5a66d965-c9cd-4af8-80a1-0881da312893 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1569 microversion: 2.1 time: 0.163863 Jan 17 21:28:48.715969 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 483/960] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:48 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:48.894042 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d3f0423e-7aaa-4808-8afc-61b17d79a008 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:48.894770 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d3f0423e-7aaa-4808-8afc-61b17d79a008 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:48.901947 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3f0423e-7aaa-4808-8afc-61b17d79a008 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:48.902396 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3f0423e-7aaa-4808-8afc-61b17d79a008 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:48.903198 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3f0423e-7aaa-4808-8afc-61b17d79a008 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:48.903643 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3f0423e-7aaa-4808-8afc-61b17d79a008 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:48.936138 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3f0423e-7aaa-4808-8afc-61b17d79a008 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:48.936617 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3f0423e-7aaa-4808-8afc-61b17d79a008 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:48.937067 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.objects.instance [None req-d3f0423e-7aaa-4808-8afc-61b17d79a008 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lazy-loading 'fault' on Instance uuid 851b3dd1-961b-4d23-9594-2a55d4f0f703 {{(pid=116183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:28:48.979606 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-d3f0423e-7aaa-4808-8afc-61b17d79a008 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:48.987353 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d3f0423e-7aaa-4808-8afc-61b17d79a008 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 200 len: 1230 microversion: 2.1 time: 0.232503 Jan 17 21:28:48.988090 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 478/961] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:48 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 1230 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:49.732854 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a4438923-492d-46e1-9576-6a52ef04f52a tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:49.733510 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a4438923-492d-46e1-9576-6a52ef04f52a tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:49.739991 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4438923-492d-46e1-9576-6a52ef04f52a tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:49.740496 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4438923-492d-46e1-9576-6a52ef04f52a tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:49.741301 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4438923-492d-46e1-9576-6a52ef04f52a tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:49.741748 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a4438923-492d-46e1-9576-6a52ef04f52a tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:49.885934 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a4438923-492d-46e1-9576-6a52ef04f52a tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:49.894319 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a4438923-492d-46e1-9576-6a52ef04f52a tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1569 microversion: 2.1 time: 0.164891 Jan 17 21:28:49.894947 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 484/962] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:49 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:28:50.004248 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1519f0b5-7965-485c-b1c7-632ab6874c50 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:50.005484 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1519f0b5-7965-485c-b1c7-632ab6874c50 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:50.012340 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1519f0b5-7965-485c-b1c7-632ab6874c50 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:50.012822 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1519f0b5-7965-485c-b1c7-632ab6874c50 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:50.013791 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1519f0b5-7965-485c-b1c7-632ab6874c50 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:50.014386 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1519f0b5-7965-485c-b1c7-632ab6874c50 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:50.028305 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-1519f0b5-7965-485c-b1c7-632ab6874c50 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] HTTP exception thrown: Instance 851b3dd1-961b-4d23-9594-2a55d4f0f703 could not be found. Jan 17 21:28:50.028820 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1519f0b5-7965-485c-b1c7-632ab6874c50 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Returning 404 to user: Instance 851b3dd1-961b-4d23-9594-2a55d4f0f703 could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:28:50.029688 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1519f0b5-7965-485c-b1c7-632ab6874c50 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 404 len: 111 microversion: 2.1 time: 0.029058 Jan 17 21:28:50.030232 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 479/963] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:49 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:28:50.080026 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1571278559", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-577368355", "security_groups": [{"name": "tempest-secgroup-smoke-763362693"}], "block_device_mapping_v2": [{"uuid": "2290f6d9-ab41-4a47-80b8-dca70b6e32de", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5af0e6ef-b600-4363-b491-e83498d1d2b9"}]}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:28:50.194652 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.network.neutron [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] validate_networks() for [('5af0e6ef-b600-4363-b491-e83498d1d2b9', None, None, None, None, None)] {{(pid=116182) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:28:50.600329 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Flavor limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:28:50.600781 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Image limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:28:50.601289 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Flavor pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:28:50.601693 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Image pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:28:50.602745 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:28:50.613768 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:50.614214 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:50.615028 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:50.615462 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:50.632242 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Getting quotas for project 97b00002d33945c6a8056483b241fbf6. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:28:50.636923 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Getting quotas for user 0cd489955c19471891724ec1badc11ee and project 97b00002d33945c6a8056483b241fbf6. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:28:50.715612 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Going to run 1 instances... {{(pid=116182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:28:50.718312 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2290f6d9-ab41-4a47-80b8-dca70b6e32de',volume_size=None,volume_type=None)] {{(pid=116182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:28:50.850119 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2b38e114-2a7d-4e90-8374-59ed97a0bee4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.773510 Jan 17 21:28:50.851582 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 485/964] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:28:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:28:50.862502 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2efb0761-19c7-444a-bbd1-bcec79041405 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:50.863070 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2efb0761-19c7-444a-bbd1-bcec79041405 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:50.913683 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fc6f0095-3ff7-4304-ad1a-5e64ca150be0 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:50.914387 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fc6f0095-3ff7-4304-ad1a-5e64ca150be0 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:50.934461 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2efb0761-19c7-444a-bbd1-bcec79041405 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:50.941449 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2efb0761-19c7-444a-bbd1-bcec79041405 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1094 microversion: 2.1 time: 0.082634 Jan 17 21:28:50.944143 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 480/965] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:50 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:28:51.082692 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fc6f0095-3ff7-4304-ad1a-5e64ca150be0 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:51.083427 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fc6f0095-3ff7-4304-ad1a-5e64ca150be0 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:51.084248 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fc6f0095-3ff7-4304-ad1a-5e64ca150be0 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:51.084810 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fc6f0095-3ff7-4304-ad1a-5e64ca150be0 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:51.263124 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-fc6f0095-3ff7-4304-ad1a-5e64ca150be0 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:51.271348 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fc6f0095-3ff7-4304-ad1a-5e64ca150be0 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1569 microversion: 2.1 time: 0.363052 Jan 17 21:28:51.271939 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 486/966] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:50 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1569 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:51.969341 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-34cc47a0-e1d5-4fbb-aa26-bd167de76ab1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:51.970007 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-34cc47a0-e1d5-4fbb-aa26-bd167de76ab1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:51.979784 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-34cc47a0-e1d5-4fbb-aa26-bd167de76ab1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:51.981118 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-34cc47a0-e1d5-4fbb-aa26-bd167de76ab1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:51.982520 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-34cc47a0-e1d5-4fbb-aa26-bd167de76ab1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:51.983175 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-34cc47a0-e1d5-4fbb-aa26-bd167de76ab1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:52.096786 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-34cc47a0-e1d5-4fbb-aa26-bd167de76ab1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:52.106912 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-34cc47a0-e1d5-4fbb-aa26-bd167de76ab1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1210 microversion: 2.1 time: 0.149318 Jan 17 21:28:52.107716 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 481/967] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:51 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1210 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:52.288851 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-00548b49-0e27-4c8c-859c-ff63b7e52a59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:52.289498 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-00548b49-0e27-4c8c-859c-ff63b7e52a59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:52.296430 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-00548b49-0e27-4c8c-859c-ff63b7e52a59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:52.296900 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-00548b49-0e27-4c8c-859c-ff63b7e52a59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:52.297921 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-00548b49-0e27-4c8c-859c-ff63b7e52a59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:52.298380 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-00548b49-0e27-4c8c-859c-ff63b7e52a59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:52.454938 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-00548b49-0e27-4c8c-859c-ff63b7e52a59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:52.466226 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-00548b49-0e27-4c8c-859c-ff63b7e52a59 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1569 microversion: 2.1 time: 0.180575 Jan 17 21:28:52.467592 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 487/968] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:52 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:28:53.137645 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ac8fc5b6-cb96-44ca-9c4b-e71b541d05c5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:53.138784 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ac8fc5b6-cb96-44ca-9c4b-e71b541d05c5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:53.149226 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ac8fc5b6-cb96-44ca-9c4b-e71b541d05c5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:53.149907 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ac8fc5b6-cb96-44ca-9c4b-e71b541d05c5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:53.151035 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ac8fc5b6-cb96-44ca-9c4b-e71b541d05c5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:53.151631 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ac8fc5b6-cb96-44ca-9c4b-e71b541d05c5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:53.302706 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ac8fc5b6-cb96-44ca-9c4b-e71b541d05c5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:53.310636 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ac8fc5b6-cb96-44ca-9c4b-e71b541d05c5 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1265 microversion: 2.1 time: 0.180640 Jan 17 21:28:53.311229 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 482/969] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:53 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:53.484769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5306f4d2-e91f-457c-b2bf-fce8bee58f60 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:53.485609 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5306f4d2-e91f-457c-b2bf-fce8bee58f60 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:53.492625 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5306f4d2-e91f-457c-b2bf-fce8bee58f60 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:53.492953 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5306f4d2-e91f-457c-b2bf-fce8bee58f60 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:53.493760 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5306f4d2-e91f-457c-b2bf-fce8bee58f60 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:53.494212 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5306f4d2-e91f-457c-b2bf-fce8bee58f60 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:53.636339 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5306f4d2-e91f-457c-b2bf-fce8bee58f60 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:53.644353 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5306f4d2-e91f-457c-b2bf-fce8bee58f60 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1569 microversion: 2.1 time: 0.163512 Jan 17 21:28:53.645968 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 488/970] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:53 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:54.048623 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-9a031a54-66c2-4bdc-98c5-4e5ac994370f req-2c6040e9-3ff2-4a90-b40e-9a9cbf09c7ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1b3ad9-6be9-4165-aea2-3a8bce7657b1", "tag": "49b3d1af-2602-4952-bb5a-f5c52e593c91"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:28:54.050281 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:28:54.050281 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:28:54.069232 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-9a031a54-66c2-4bdc-98c5-4e5ac994370f req-2c6040e9-3ff2-4a90-b40e-9a9cbf09c7ac service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:54.069762 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-9a031a54-66c2-4bdc-98c5-4e5ac994370f req-2c6040e9-3ff2-4a90-b40e-9a9cbf09c7ac service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:54.089249 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-9a031a54-66c2-4bdc-98c5-4e5ac994370f req-2c6040e9-3ff2-4a90-b40e-9a9cbf09c7ac service nova] Creating event network-changed:49b3d1af-2602-4952-bb5a-f5c52e593c91 for instance 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 on hv-cinder-82489 Jan 17 21:28:54.094458 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-9a031a54-66c2-4bdc-98c5-4e5ac994370f req-2c6040e9-3ff2-4a90-b40e-9a9cbf09c7ac service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056878 Jan 17 21:28:54.095541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 483/971] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:28:54.330774 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c5a0df5f-ea07-4cad-9804-0d94b10f3c6b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:54.332386 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c5a0df5f-ea07-4cad-9804-0d94b10f3c6b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:54.346312 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c5a0df5f-ea07-4cad-9804-0d94b10f3c6b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:54.347093 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c5a0df5f-ea07-4cad-9804-0d94b10f3c6b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:54.348555 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c5a0df5f-ea07-4cad-9804-0d94b10f3c6b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:54.349349 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c5a0df5f-ea07-4cad-9804-0d94b10f3c6b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:54.507003 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c5a0df5f-ea07-4cad-9804-0d94b10f3c6b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:54.514688 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c5a0df5f-ea07-4cad-9804-0d94b10f3c6b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1265 microversion: 2.1 time: 0.190965 Jan 17 21:28:54.515274 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 489/972] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:54 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:54.663449 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d2ff0592-8923-4ec7-a9c1-34eae5af9151 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:54.664151 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d2ff0592-8923-4ec7-a9c1-34eae5af9151 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:54.671369 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d2ff0592-8923-4ec7-a9c1-34eae5af9151 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:54.671816 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d2ff0592-8923-4ec7-a9c1-34eae5af9151 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:54.672653 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d2ff0592-8923-4ec7-a9c1-34eae5af9151 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:54.673091 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d2ff0592-8923-4ec7-a9c1-34eae5af9151 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:54.833108 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-d2ff0592-8923-4ec7-a9c1-34eae5af9151 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:54.845613 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d2ff0592-8923-4ec7-a9c1-34eae5af9151 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1569 microversion: 2.1 time: 0.186612 Jan 17 21:28:54.846218 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 484/973] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:54 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:55.531358 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4f579c01-20f7-41c7-a416-393fb23a96eb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:55.531971 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4f579c01-20f7-41c7-a416-393fb23a96eb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:55.538665 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4f579c01-20f7-41c7-a416-393fb23a96eb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:55.539389 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4f579c01-20f7-41c7-a416-393fb23a96eb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:55.540212 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4f579c01-20f7-41c7-a416-393fb23a96eb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:55.540698 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4f579c01-20f7-41c7-a416-393fb23a96eb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:55.686201 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4f579c01-20f7-41c7-a416-393fb23a96eb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:55.700691 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4f579c01-20f7-41c7-a416-393fb23a96eb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1265 microversion: 2.1 time: 0.172863 Jan 17 21:28:55.701289 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 490/974] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:55 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:55.869468 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-068fc4ba-3231-43d8-b9a5-772aae7bf100 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:55.870242 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-068fc4ba-3231-43d8-b9a5-772aae7bf100 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:55.878545 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-068fc4ba-3231-43d8-b9a5-772aae7bf100 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:55.879005 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-068fc4ba-3231-43d8-b9a5-772aae7bf100 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:55.879813 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-068fc4ba-3231-43d8-b9a5-772aae7bf100 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:55.880266 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-068fc4ba-3231-43d8-b9a5-772aae7bf100 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:56.022379 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-068fc4ba-3231-43d8-b9a5-772aae7bf100 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:56.030612 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-068fc4ba-3231-43d8-b9a5-772aae7bf100 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1570 microversion: 2.1 time: 0.164877 Jan 17 21:28:56.031183 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 485/975] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:55 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:56.047366 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-28878d89-1010-47a2-8bb4-34c4c6ee33dc tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:28:56.047934 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-28878d89-1010-47a2-8bb4-34c4c6ee33dc tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:56.054814 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-28878d89-1010-47a2-8bb4-34c4c6ee33dc tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:56.055441 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-28878d89-1010-47a2-8bb4-34c4c6ee33dc tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:56.056494 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-28878d89-1010-47a2-8bb4-34c4c6ee33dc tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:56.057047 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-28878d89-1010-47a2-8bb4-34c4c6ee33dc tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:56.158260 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-28878d89-1010-47a2-8bb4-34c4c6ee33dc tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "POST /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8/action" status: 202 len: 0 microversion: 2.1 time: 0.114581 Jan 17 21:28:56.160417 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 491/976] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:28:56 2022] POST /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:28:56.171799 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-91567ada-711b-4425-b17d-be95d210c77f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:56.173051 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-91567ada-711b-4425-b17d-be95d210c77f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:56.189306 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-91567ada-711b-4425-b17d-be95d210c77f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:56.190237 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-91567ada-711b-4425-b17d-be95d210c77f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:56.191794 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-91567ada-711b-4425-b17d-be95d210c77f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:56.192937 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-91567ada-711b-4425-b17d-be95d210c77f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:56.276592 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-78ec5aba-30b2-4a87-b89b-002921e1e1ac tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:28:56.277662 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-78ec5aba-30b2-4a87-b89b-002921e1e1ac tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:56.284109 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-78ec5aba-30b2-4a87-b89b-002921e1e1ac tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:56.284612 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-78ec5aba-30b2-4a87-b89b-002921e1e1ac tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:56.285436 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-78ec5aba-30b2-4a87-b89b-002921e1e1ac tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:56.285883 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-78ec5aba-30b2-4a87-b89b-002921e1e1ac tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:56.378362 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-78ec5aba-30b2-4a87-b89b-002921e1e1ac tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "POST /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/action" status: 202 len: 0 microversion: 2.1 time: 0.104844 Jan 17 21:28:56.379261 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 492/977] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:28:56 2022] POST /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:28:56.389883 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e8756626-4b9b-447c-9918-12775ee50936 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:56.390569 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e8756626-4b9b-447c-9918-12775ee50936 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:56.397535 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e8756626-4b9b-447c-9918-12775ee50936 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:56.397854 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e8756626-4b9b-447c-9918-12775ee50936 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:56.399032 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e8756626-4b9b-447c-9918-12775ee50936 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:56.399486 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e8756626-4b9b-447c-9918-12775ee50936 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:56.405642 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-91567ada-711b-4425-b17d-be95d210c77f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:56.421464 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-91567ada-711b-4425-b17d-be95d210c77f tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1518 microversion: 2.1 time: 0.254503 Jan 17 21:28:56.423035 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 486/978] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:56 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1518 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:56.647664 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-e8756626-4b9b-447c-9918-12775ee50936 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:56.661920 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e8756626-4b9b-447c-9918-12775ee50936 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1749 microversion: 2.1 time: 0.275743 Jan 17 21:28:56.662996 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 493/979] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:56 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1749 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:56.718646 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2c19627a-8032-4ff9-9bd2-60045c488e76 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:56.719523 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2c19627a-8032-4ff9-9bd2-60045c488e76 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:56.725945 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c19627a-8032-4ff9-9bd2-60045c488e76 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:56.726413 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c19627a-8032-4ff9-9bd2-60045c488e76 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:56.727742 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c19627a-8032-4ff9-9bd2-60045c488e76 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:56.728181 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c19627a-8032-4ff9-9bd2-60045c488e76 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:56.894561 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2c19627a-8032-4ff9-9bd2-60045c488e76 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:56.903161 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2c19627a-8032-4ff9-9bd2-60045c488e76 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1265 microversion: 2.1 time: 0.188235 Jan 17 21:28:56.903749 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 487/980] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:56 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:57.447408 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e157d444-d39e-4c55-a5db-923e2d5a7310 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:57.447950 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e157d444-d39e-4c55-a5db-923e2d5a7310 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:57.454618 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e157d444-d39e-4c55-a5db-923e2d5a7310 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:57.455088 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e157d444-d39e-4c55-a5db-923e2d5a7310 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:57.455910 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e157d444-d39e-4c55-a5db-923e2d5a7310 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:57.456359 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e157d444-d39e-4c55-a5db-923e2d5a7310 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:57.616114 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-e157d444-d39e-4c55-a5db-923e2d5a7310 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:57.624695 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e157d444-d39e-4c55-a5db-923e2d5a7310 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1576 microversion: 2.1 time: 0.181039 Jan 17 21:28:57.625282 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 494/981] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:57 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:28:57.681369 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a8776d2a-93b4-405d-a973-36082a283562 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:57.681989 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a8776d2a-93b4-405d-a973-36082a283562 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:57.688573 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a8776d2a-93b4-405d-a973-36082a283562 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:57.689054 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a8776d2a-93b4-405d-a973-36082a283562 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:57.689963 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a8776d2a-93b4-405d-a973-36082a283562 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:57.690407 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a8776d2a-93b4-405d-a973-36082a283562 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:57.875384 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-a8776d2a-93b4-405d-a973-36082a283562 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:57.885910 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a8776d2a-93b4-405d-a973-36082a283562 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1754 microversion: 2.1 time: 0.208898 Jan 17 21:28:57.886510 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 488/982] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:57 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1754 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:57.929187 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e4408f0b-8276-4009-9c0a-08e8077101ce tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:57.929979 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e4408f0b-8276-4009-9c0a-08e8077101ce tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:57.936836 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e4408f0b-8276-4009-9c0a-08e8077101ce tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:57.937291 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e4408f0b-8276-4009-9c0a-08e8077101ce tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:57.938104 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e4408f0b-8276-4009-9c0a-08e8077101ce tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:57.938545 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e4408f0b-8276-4009-9c0a-08e8077101ce tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:58.107084 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-e4408f0b-8276-4009-9c0a-08e8077101ce tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:58.114705 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e4408f0b-8276-4009-9c0a-08e8077101ce tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1265 microversion: 2.1 time: 0.189735 Jan 17 21:28:58.115826 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 495/983] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:57 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:58.642500 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-60ee2eb4-93f2-4701-a12f-603fe4060b85 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:58.643098 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-60ee2eb4-93f2-4701-a12f-603fe4060b85 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:58.649320 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-60ee2eb4-93f2-4701-a12f-603fe4060b85 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:58.649768 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-60ee2eb4-93f2-4701-a12f-603fe4060b85 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:58.650549 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-60ee2eb4-93f2-4701-a12f-603fe4060b85 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:58.650982 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-60ee2eb4-93f2-4701-a12f-603fe4060b85 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:58.791041 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-60ee2eb4-93f2-4701-a12f-603fe4060b85 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:58.801046 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-60ee2eb4-93f2-4701-a12f-603fe4060b85 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1576 microversion: 2.1 time: 0.162095 Jan 17 21:28:58.801743 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 489/984] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:58 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:58.903973 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-41df11a3-2c89-47bd-a63e-d52c5e271c0e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:58.904540 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-41df11a3-2c89-47bd-a63e-d52c5e271c0e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:58.911371 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41df11a3-2c89-47bd-a63e-d52c5e271c0e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:58.911857 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41df11a3-2c89-47bd-a63e-d52c5e271c0e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:58.912689 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41df11a3-2c89-47bd-a63e-d52c5e271c0e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:58.913135 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41df11a3-2c89-47bd-a63e-d52c5e271c0e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:59.066087 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-41df11a3-2c89-47bd-a63e-d52c5e271c0e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:59.074708 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-41df11a3-2c89-47bd-a63e-d52c5e271c0e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1754 microversion: 2.1 time: 0.174480 Jan 17 21:28:59.075282 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 496/985] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:58 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:28:59.130509 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ec5043eb-c660-40ef-8f2a-6a96ca9b7b97 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:59.131152 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ec5043eb-c660-40ef-8f2a-6a96ca9b7b97 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:59.137733 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec5043eb-c660-40ef-8f2a-6a96ca9b7b97 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:59.138197 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec5043eb-c660-40ef-8f2a-6a96ca9b7b97 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:59.138983 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec5043eb-c660-40ef-8f2a-6a96ca9b7b97 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:59.139420 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec5043eb-c660-40ef-8f2a-6a96ca9b7b97 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:59.291251 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ec5043eb-c660-40ef-8f2a-6a96ca9b7b97 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:28:59.300634 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ec5043eb-c660-40ef-8f2a-6a96ca9b7b97 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1265 microversion: 2.1 time: 0.173620 Jan 17 21:28:59.301285 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 490/986] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:59 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:28:59.821020 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b82459e6-18ac-4c21-b032-ed153ef2a611 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:28:59.821813 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b82459e6-18ac-4c21-b032-ed153ef2a611 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:28:59.828867 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b82459e6-18ac-4c21-b032-ed153ef2a611 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:59.829475 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b82459e6-18ac-4c21-b032-ed153ef2a611 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:59.830459 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b82459e6-18ac-4c21-b032-ed153ef2a611 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:28:59.831062 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b82459e6-18ac-4c21-b032-ed153ef2a611 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:28:59.997959 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b82459e6-18ac-4c21-b032-ed153ef2a611 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:00.006307 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b82459e6-18ac-4c21-b032-ed153ef2a611 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1576 microversion: 2.1 time: 0.191119 Jan 17 21:29:00.007291 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 497/987] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:28:59 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:00.091917 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1ef50245-3dd6-4091-a48a-2207b052b09d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:00.092575 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1ef50245-3dd6-4091-a48a-2207b052b09d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:00.099277 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1ef50245-3dd6-4091-a48a-2207b052b09d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:00.099729 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1ef50245-3dd6-4091-a48a-2207b052b09d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:00.100565 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1ef50245-3dd6-4091-a48a-2207b052b09d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:00.101005 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1ef50245-3dd6-4091-a48a-2207b052b09d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:00.265360 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1ef50245-3dd6-4091-a48a-2207b052b09d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:00.274845 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1ef50245-3dd6-4091-a48a-2207b052b09d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1754 microversion: 2.1 time: 0.186591 Jan 17 21:29:00.275541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 491/988] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:00 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:00.318235 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2c4fd25b-3bba-41c6-abed-d9c42552bc62 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:00.319527 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2c4fd25b-3bba-41c6-abed-d9c42552bc62 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:00.327741 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2c4fd25b-3bba-41c6-abed-d9c42552bc62 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:00.328338 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2c4fd25b-3bba-41c6-abed-d9c42552bc62 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:00.329344 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2c4fd25b-3bba-41c6-abed-d9c42552bc62 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:00.330058 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2c4fd25b-3bba-41c6-abed-d9c42552bc62 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:00.400260 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-93682d8a-9759-49c5-87dc-bf1791bc2de1 req-57435035-e7a9-45d6-91bd-db9f7865be66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a05a7cb-fb38-46fe-a04b-f8c66845fbd8", "name": "network-vif-unplugged", "status": "completed", "tag": "858678d3-306c-4afa-9059-494f90b38571"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:00.403492 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:29:00.403492 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:29:00.412261 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-93682d8a-9759-49c5-87dc-bf1791bc2de1 req-57435035-e7a9-45d6-91bd-db9f7865be66 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:00.413762 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-93682d8a-9759-49c5-87dc-bf1791bc2de1 req-57435035-e7a9-45d6-91bd-db9f7865be66 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:00.443579 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-93682d8a-9759-49c5-87dc-bf1791bc2de1 req-57435035-e7a9-45d6-91bd-db9f7865be66 service nova] Creating event network-vif-unplugged:858678d3-306c-4afa-9059-494f90b38571 for instance 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 on hv-cinder-82489 Jan 17 21:29:00.452809 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-93682d8a-9759-49c5-87dc-bf1791bc2de1 req-57435035-e7a9-45d6-91bd-db9f7865be66 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057221 Jan 17 21:29:00.454197 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 492/989] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:29:00.497874 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2c4fd25b-3bba-41c6-abed-d9c42552bc62 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:00.506076 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2c4fd25b-3bba-41c6-abed-d9c42552bc62 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1265 microversion: 2.1 time: 0.191469 Jan 17 21:29:00.506679 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 498/990] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:00 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:01.025430 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-46273bbc-6911-47e7-b4a6-bb66f451b194 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:01.026135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-46273bbc-6911-47e7-b4a6-bb66f451b194 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:01.032838 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-46273bbc-6911-47e7-b4a6-bb66f451b194 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:01.033302 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-46273bbc-6911-47e7-b4a6-bb66f451b194 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:01.034117 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-46273bbc-6911-47e7-b4a6-bb66f451b194 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:01.034562 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-46273bbc-6911-47e7-b4a6-bb66f451b194 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:01.196086 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-46273bbc-6911-47e7-b4a6-bb66f451b194 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:01.203959 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-46273bbc-6911-47e7-b4a6-bb66f451b194 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1576 microversion: 2.1 time: 0.182969 Jan 17 21:29:01.204573 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 493/991] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:01 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:01.299366 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1250cab9-efa0-4958-907d-0dc4d30a01d9 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:01.299885 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1250cab9-efa0-4958-907d-0dc4d30a01d9 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:01.306551 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1250cab9-efa0-4958-907d-0dc4d30a01d9 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:01.307008 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1250cab9-efa0-4958-907d-0dc4d30a01d9 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:01.307844 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1250cab9-efa0-4958-907d-0dc4d30a01d9 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:01.308287 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1250cab9-efa0-4958-907d-0dc4d30a01d9 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:01.521187 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1250cab9-efa0-4958-907d-0dc4d30a01d9 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:01.523105 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ded3b2fe-7635-470d-bb93-9b7d6eac1df9 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:01.523907 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ded3b2fe-7635-470d-bb93-9b7d6eac1df9 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:01.532793 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ded3b2fe-7635-470d-bb93-9b7d6eac1df9 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:01.533068 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1250cab9-efa0-4958-907d-0dc4d30a01d9 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1754 microversion: 2.1 time: 0.237186 Jan 17 21:29:01.533545 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ded3b2fe-7635-470d-bb93-9b7d6eac1df9 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:01.533887 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 499/992] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:01 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1754 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:01.534461 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ded3b2fe-7635-470d-bb93-9b7d6eac1df9 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:01.534915 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ded3b2fe-7635-470d-bb93-9b7d6eac1df9 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:01.704176 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ded3b2fe-7635-470d-bb93-9b7d6eac1df9 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:01.712435 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ded3b2fe-7635-470d-bb93-9b7d6eac1df9 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1265 microversion: 2.1 time: 0.192907 Jan 17 21:29:01.713098 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 494/993] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:01 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:29:02.222583 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-57841591-ae36-4d43-9769-a17148431317 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:02.223198 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-57841591-ae36-4d43-9769-a17148431317 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:02.230320 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-57841591-ae36-4d43-9769-a17148431317 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:02.230774 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-57841591-ae36-4d43-9769-a17148431317 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:02.231573 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-57841591-ae36-4d43-9769-a17148431317 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:02.232016 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-57841591-ae36-4d43-9769-a17148431317 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:02.378904 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-57841591-ae36-4d43-9769-a17148431317 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:02.386813 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-57841591-ae36-4d43-9769-a17148431317 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1576 microversion: 2.1 time: 0.168076 Jan 17 21:29:02.387389 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 500/994] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:02 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:02.552423 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-385e104f-e144-4ec0-a150-880f10c77c3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:02.553027 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-385e104f-e144-4ec0-a150-880f10c77c3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:02.560234 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-385e104f-e144-4ec0-a150-880f10c77c3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:02.560715 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-385e104f-e144-4ec0-a150-880f10c77c3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:02.561511 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-385e104f-e144-4ec0-a150-880f10c77c3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:02.561948 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-385e104f-e144-4ec0-a150-880f10c77c3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:02.720766 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-385e104f-e144-4ec0-a150-880f10c77c3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:02.729526 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-385e104f-e144-4ec0-a150-880f10c77c3e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1754 microversion: 2.1 time: 0.180622 Jan 17 21:29:02.732666 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 495/995] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:02 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:02.732854 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-054645a4-6f8e-4a6c-81ce-dc2c807c8055 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:02.732854 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-054645a4-6f8e-4a6c-81ce-dc2c807c8055 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:02.738135 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-054645a4-6f8e-4a6c-81ce-dc2c807c8055 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:02.738592 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-054645a4-6f8e-4a6c-81ce-dc2c807c8055 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:02.739388 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-054645a4-6f8e-4a6c-81ce-dc2c807c8055 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:02.739829 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-054645a4-6f8e-4a6c-81ce-dc2c807c8055 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:02.904071 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-054645a4-6f8e-4a6c-81ce-dc2c807c8055 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:02.912106 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-054645a4-6f8e-4a6c-81ce-dc2c807c8055 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1265 microversion: 2.1 time: 0.185426 Jan 17 21:29:02.912825 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 501/996] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:02 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:29:03.404138 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7541caf4-b74e-40c3-a653-410ea512e424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:03.404786 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7541caf4-b74e-40c3-a653-410ea512e424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:03.411188 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7541caf4-b74e-40c3-a653-410ea512e424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:03.411699 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7541caf4-b74e-40c3-a653-410ea512e424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:03.412621 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7541caf4-b74e-40c3-a653-410ea512e424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:03.413223 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7541caf4-b74e-40c3-a653-410ea512e424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:03.717738 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7541caf4-b74e-40c3-a653-410ea512e424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:03.725319 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7541caf4-b74e-40c3-a653-410ea512e424 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1576 microversion: 2.1 time: 0.325362 Jan 17 21:29:03.725911 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 496/997] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:03 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1576 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:03.749744 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0f7c384c-ebc6-40f4-8849-6f3313f55ecc tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:03.750622 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0f7c384c-ebc6-40f4-8849-6f3313f55ecc tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:03.757140 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0f7c384c-ebc6-40f4-8849-6f3313f55ecc tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:03.757599 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0f7c384c-ebc6-40f4-8849-6f3313f55ecc tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:03.759053 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0f7c384c-ebc6-40f4-8849-6f3313f55ecc tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:03.759806 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0f7c384c-ebc6-40f4-8849-6f3313f55ecc tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:03.915792 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-0f7c384c-ebc6-40f4-8849-6f3313f55ecc tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:03.924195 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0f7c384c-ebc6-40f4-8849-6f3313f55ecc tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1754 microversion: 2.1 time: 0.177870 Jan 17 21:29:03.924602 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 502/998] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:03 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:03.931377 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e87a26e7-18e7-4dd1-9512-0c043f1a4533 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:03.932050 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-e87a26e7-18e7-4dd1-9512-0c043f1a4533 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:03.938242 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e87a26e7-18e7-4dd1-9512-0c043f1a4533 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:03.938687 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e87a26e7-18e7-4dd1-9512-0c043f1a4533 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:03.939498 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e87a26e7-18e7-4dd1-9512-0c043f1a4533 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:03.939947 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e87a26e7-18e7-4dd1-9512-0c043f1a4533 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:04.105243 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-e87a26e7-18e7-4dd1-9512-0c043f1a4533 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:04.113088 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e87a26e7-18e7-4dd1-9512-0c043f1a4533 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1265 microversion: 2.1 time: 0.187318 Jan 17 21:29:04.113656 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 497/999] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:03 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:04.742981 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-51bbde89-42cf-406b-b726-fe79b55089c1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:04.743688 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-51bbde89-42cf-406b-b726-fe79b55089c1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:04.750743 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-51bbde89-42cf-406b-b726-fe79b55089c1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:04.751424 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-51bbde89-42cf-406b-b726-fe79b55089c1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:04.752234 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-51bbde89-42cf-406b-b726-fe79b55089c1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:04.752851 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-51bbde89-42cf-406b-b726-fe79b55089c1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:04.902954 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-51bbde89-42cf-406b-b726-fe79b55089c1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:04.911322 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-51bbde89-42cf-406b-b726-fe79b55089c1 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1576 microversion: 2.1 time: 0.172445 Jan 17 21:29:04.911925 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 503/1000] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:04 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:04.945890 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-09f3495e-2b81-42e0-a28e-ebfef965a173 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:04.947050 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-09f3495e-2b81-42e0-a28e-ebfef965a173 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:04.958851 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-09f3495e-2b81-42e0-a28e-ebfef965a173 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:04.959704 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-09f3495e-2b81-42e0-a28e-ebfef965a173 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:04.961761 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-09f3495e-2b81-42e0-a28e-ebfef965a173 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:04.962563 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-09f3495e-2b81-42e0-a28e-ebfef965a173 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:05.132234 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b383f148-6c5b-4819-9452-8e62e28e8254 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:05.133801 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b383f148-6c5b-4819-9452-8e62e28e8254 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:05.141533 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b383f148-6c5b-4819-9452-8e62e28e8254 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:05.142439 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b383f148-6c5b-4819-9452-8e62e28e8254 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:05.143591 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b383f148-6c5b-4819-9452-8e62e28e8254 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:05.144189 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b383f148-6c5b-4819-9452-8e62e28e8254 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:05.158368 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-09f3495e-2b81-42e0-a28e-ebfef965a173 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:05.167491 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-09f3495e-2b81-42e0-a28e-ebfef965a173 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1754 microversion: 2.1 time: 0.228864 Jan 17 21:29:05.168183 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 498/1001] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:04 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1754 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:05.288848 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b383f148-6c5b-4819-9452-8e62e28e8254 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:05.296553 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b383f148-6c5b-4819-9452-8e62e28e8254 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1265 microversion: 2.1 time: 0.169277 Jan 17 21:29:05.297132 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 504/1002] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:05 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:29:05.930149 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ea875924-cd5f-4a03-b9c6-4bf3099f5571 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:05.930818 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ea875924-cd5f-4a03-b9c6-4bf3099f5571 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:05.937104 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ea875924-cd5f-4a03-b9c6-4bf3099f5571 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:05.937571 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ea875924-cd5f-4a03-b9c6-4bf3099f5571 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:05.938384 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ea875924-cd5f-4a03-b9c6-4bf3099f5571 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:05.938825 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ea875924-cd5f-4a03-b9c6-4bf3099f5571 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:06.108679 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ea875924-cd5f-4a03-b9c6-4bf3099f5571 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:06.119983 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ea875924-cd5f-4a03-b9c6-4bf3099f5571 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1576 microversion: 2.1 time: 0.193992 Jan 17 21:29:06.120617 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 499/1003] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:05 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:06.185160 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-eb5a5a1e-534b-4ff2-b8ec-f40435d8c790 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:06.185846 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-eb5a5a1e-534b-4ff2-b8ec-f40435d8c790 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:06.192348 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eb5a5a1e-534b-4ff2-b8ec-f40435d8c790 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:06.192848 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eb5a5a1e-534b-4ff2-b8ec-f40435d8c790 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:06.193782 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eb5a5a1e-534b-4ff2-b8ec-f40435d8c790 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:06.194231 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eb5a5a1e-534b-4ff2-b8ec-f40435d8c790 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:06.316359 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-72eb5705-e13c-4163-9aac-e00ff1d3be2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:06.317230 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-72eb5705-e13c-4163-9aac-e00ff1d3be2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:06.324689 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-72eb5705-e13c-4163-9aac-e00ff1d3be2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:06.325520 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-72eb5705-e13c-4163-9aac-e00ff1d3be2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:06.326595 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-72eb5705-e13c-4163-9aac-e00ff1d3be2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:06.327204 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-72eb5705-e13c-4163-9aac-e00ff1d3be2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:06.412726 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-eb5a5a1e-534b-4ff2-b8ec-f40435d8c790 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:06.422805 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-eb5a5a1e-534b-4ff2-b8ec-f40435d8c790 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1754 microversion: 2.1 time: 0.241278 Jan 17 21:29:06.423730 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 505/1004] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:06 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1754 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:06.478436 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-54537047-c41a-44e4-8e6a-3fe218695270 req-77876670-d160-45e8-8bd9-af5bd24971b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1b3ad9-6be9-4165-aea2-3a8bce7657b1", "name": "network-vif-plugged", "status": "completed", "tag": "49b3d1af-2602-4952-bb5a-f5c52e593c91"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:06.480070 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:29:06.480070 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:29:06.487727 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-54537047-c41a-44e4-8e6a-3fe218695270 req-77876670-d160-45e8-8bd9-af5bd24971b7 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:06.488181 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-54537047-c41a-44e4-8e6a-3fe218695270 req-77876670-d160-45e8-8bd9-af5bd24971b7 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:06.500231 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-54537047-c41a-44e4-8e6a-3fe218695270 req-77876670-d160-45e8-8bd9-af5bd24971b7 service nova] Creating event network-vif-plugged:49b3d1af-2602-4952-bb5a-f5c52e593c91 for instance 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 on hv-cinder-82489 Jan 17 21:29:06.505589 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-54537047-c41a-44e4-8e6a-3fe218695270 req-77876670-d160-45e8-8bd9-af5bd24971b7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030775 Jan 17 21:29:06.506496 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 506/1005] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:29:06.508038 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-72eb5705-e13c-4163-9aac-e00ff1d3be2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:06.515416 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-72eb5705-e13c-4163-9aac-e00ff1d3be2b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1265 microversion: 2.1 time: 0.204217 Jan 17 21:29:06.515988 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 500/1006] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:06 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:07.139739 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-842f1fad-2c1b-4d9b-b21f-5011f9d95d18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:07.140503 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-842f1fad-2c1b-4d9b-b21f-5011f9d95d18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:07.146740 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-842f1fad-2c1b-4d9b-b21f-5011f9d95d18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:07.147202 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-842f1fad-2c1b-4d9b-b21f-5011f9d95d18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:07.148008 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-842f1fad-2c1b-4d9b-b21f-5011f9d95d18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:07.148476 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-842f1fad-2c1b-4d9b-b21f-5011f9d95d18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:07.287031 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-842f1fad-2c1b-4d9b-b21f-5011f9d95d18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:07.295146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-842f1fad-2c1b-4d9b-b21f-5011f9d95d18 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1576 microversion: 2.1 time: 0.159498 Jan 17 21:29:07.295708 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 507/1007] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:07 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:07.440257 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c5c9e8e2-3ef9-43a7-8b1c-72993b4875c1 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:07.440922 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c5c9e8e2-3ef9-43a7-8b1c-72993b4875c1 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:07.447283 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c5c9e8e2-3ef9-43a7-8b1c-72993b4875c1 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:07.447732 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c5c9e8e2-3ef9-43a7-8b1c-72993b4875c1 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:07.448555 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c5c9e8e2-3ef9-43a7-8b1c-72993b4875c1 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:07.448987 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c5c9e8e2-3ef9-43a7-8b1c-72993b4875c1 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:07.533362 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1f1ed4f8-637f-4cc8-b5e6-f9dac2e30b26 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:07.533870 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1f1ed4f8-637f-4cc8-b5e6-f9dac2e30b26 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:07.541447 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1f1ed4f8-637f-4cc8-b5e6-f9dac2e30b26 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:07.541906 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1f1ed4f8-637f-4cc8-b5e6-f9dac2e30b26 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:07.542716 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1f1ed4f8-637f-4cc8-b5e6-f9dac2e30b26 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:07.543160 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1f1ed4f8-637f-4cc8-b5e6-f9dac2e30b26 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:07.631917 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-c5c9e8e2-3ef9-43a7-8b1c-72993b4875c1 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:07.640760 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c5c9e8e2-3ef9-43a7-8b1c-72993b4875c1 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1754 microversion: 2.1 time: 0.203959 Jan 17 21:29:07.641352 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 501/1008] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:07 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1754 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:07.712463 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1f1ed4f8-637f-4cc8-b5e6-f9dac2e30b26 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:07.719885 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1f1ed4f8-637f-4cc8-b5e6-f9dac2e30b26 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1265 microversion: 2.1 time: 0.190344 Jan 17 21:29:07.720492 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 508/1009] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:07 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:29:08.312785 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ae284dd7-c865-493b-b079-23f1e56ab04b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:08.313435 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ae284dd7-c865-493b-b079-23f1e56ab04b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:08.319293 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ae284dd7-c865-493b-b079-23f1e56ab04b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:08.319756 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ae284dd7-c865-493b-b079-23f1e56ab04b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:08.321168 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ae284dd7-c865-493b-b079-23f1e56ab04b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:08.321611 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ae284dd7-c865-493b-b079-23f1e56ab04b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:08.460724 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ae284dd7-c865-493b-b079-23f1e56ab04b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:08.468316 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ae284dd7-c865-493b-b079-23f1e56ab04b tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1563 microversion: 2.1 time: 0.159200 Jan 17 21:29:08.468931 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 502/1010] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:08 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:08.658556 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4679db2d-82d7-4daa-96ad-8d68f35217e7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:08.659417 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4679db2d-82d7-4daa-96ad-8d68f35217e7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:08.666368 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4679db2d-82d7-4daa-96ad-8d68f35217e7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:08.666858 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4679db2d-82d7-4daa-96ad-8d68f35217e7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:08.667725 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4679db2d-82d7-4daa-96ad-8d68f35217e7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:08.668248 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4679db2d-82d7-4daa-96ad-8d68f35217e7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:08.737508 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-45b25c5d-e3b1-4859-bfa2-d720c5ea53d3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:08.738242 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-45b25c5d-e3b1-4859-bfa2-d720c5ea53d3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:08.745467 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-45b25c5d-e3b1-4859-bfa2-d720c5ea53d3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:08.746027 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-45b25c5d-e3b1-4859-bfa2-d720c5ea53d3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:08.746918 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-45b25c5d-e3b1-4859-bfa2-d720c5ea53d3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:08.747456 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-45b25c5d-e3b1-4859-bfa2-d720c5ea53d3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:08.894133 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4679db2d-82d7-4daa-96ad-8d68f35217e7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:08.902949 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4679db2d-82d7-4daa-96ad-8d68f35217e7 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1757 microversion: 2.1 time: 0.248070 Jan 17 21:29:08.903585 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 509/1011] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:08 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1757 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:08.939955 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-45b25c5d-e3b1-4859-bfa2-d720c5ea53d3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:08.948786 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-45b25c5d-e3b1-4859-bfa2-d720c5ea53d3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1452 microversion: 2.1 time: 0.214902 Jan 17 21:29:08.952527 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 503/1012] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:08 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1452 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:29:08.970098 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7a112882-8c7a-4e99-bf21-291315667b04 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:08.971382 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7a112882-8c7a-4e99-bf21-291315667b04 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:08.982915 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7a112882-8c7a-4e99-bf21-291315667b04 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:08.983873 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7a112882-8c7a-4e99-bf21-291315667b04 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:08.985491 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7a112882-8c7a-4e99-bf21-291315667b04 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:08.986211 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7a112882-8c7a-4e99-bf21-291315667b04 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:09.135777 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7a112882-8c7a-4e99-bf21-291315667b04 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:09.143983 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7a112882-8c7a-4e99-bf21-291315667b04 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1452 microversion: 2.1 time: 0.180974 Jan 17 21:29:09.144615 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 510/1013] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:29:08 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1452 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:10.513766 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-fd5048f1-2b82-4854-97b5-764adfd609e6 req-be5ab856-1daf-4259-aa16-97bb13986dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a05a7cb-fb38-46fe-a04b-f8c66845fbd8", "name": "network-vif-plugged", "status": "completed", "tag": "858678d3-306c-4afa-9059-494f90b38571"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:10.516764 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:29:10.516764 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:29:10.525223 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-fd5048f1-2b82-4854-97b5-764adfd609e6 req-be5ab856-1daf-4259-aa16-97bb13986dd5 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:10.525682 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-fd5048f1-2b82-4854-97b5-764adfd609e6 req-be5ab856-1daf-4259-aa16-97bb13986dd5 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:10.538635 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-fd5048f1-2b82-4854-97b5-764adfd609e6 req-be5ab856-1daf-4259-aa16-97bb13986dd5 service nova] Creating event network-vif-plugged:858678d3-306c-4afa-9059-494f90b38571 for instance 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 on hv-cinder-82489 Jan 17 21:29:10.544328 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-fd5048f1-2b82-4854-97b5-764adfd609e6 req-be5ab856-1daf-4259-aa16-97bb13986dd5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035547 Jan 17 21:29:10.545086 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 504/1014] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:29:11.321710 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-72d64b33-9313-4fa5-96eb-b91914878664 req-fd6e0aee-ea4b-4e76-822d-9304552ef942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1b3ad9-6be9-4165-aea2-3a8bce7657b1", "tag": "49b3d1af-2602-4952-bb5a-f5c52e593c91"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:11.324188 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:29:11.324188 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:29:11.339366 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-72d64b33-9313-4fa5-96eb-b91914878664 req-fd6e0aee-ea4b-4e76-822d-9304552ef942 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:11.339975 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-72d64b33-9313-4fa5-96eb-b91914878664 req-fd6e0aee-ea4b-4e76-822d-9304552ef942 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:11.355033 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-72d64b33-9313-4fa5-96eb-b91914878664 req-fd6e0aee-ea4b-4e76-822d-9304552ef942 service nova] Creating event network-changed:49b3d1af-2602-4952-bb5a-f5c52e593c91 for instance 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 on hv-cinder-82489 Jan 17 21:29:11.360516 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-72d64b33-9313-4fa5-96eb-b91914878664 req-fd6e0aee-ea4b-4e76-822d-9304552ef942 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044635 Jan 17 21:29:11.361073 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 511/1015] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:29:32.505550 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-eaf4903c-966a-4943-ba34-80e4ac551e41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:32.506287 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-eaf4903c-966a-4943-ba34-80e4ac551e41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:32.512451 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eaf4903c-966a-4943-ba34-80e4ac551e41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:32.512913 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eaf4903c-966a-4943-ba34-80e4ac551e41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:32.513710 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eaf4903c-966a-4943-ba34-80e4ac551e41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:32.514152 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eaf4903c-966a-4943-ba34-80e4ac551e41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:32.543295 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-eaf4903c-966a-4943-ba34-80e4ac551e41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/os-volume_attachments/d58140de-6193-45f2-8972-725304e49827" status: 200 len: 194 microversion: 2.20 time: 0.042595 Jan 17 21:29:32.543868 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 505/1016] 10.222.0.64 () {60 vars in 1453 bytes} [Mon Jan 17 21:29:32 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/os-volume_attachments/d58140de-6193-45f2-8972-725304e49827 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:29:32.605072 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-03deddc7-f9b9-4b9e-bbc7-15f71dae6183 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:32.605684 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-03deddc7-f9b9-4b9e-bbc7-15f71dae6183 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:32.611838 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03deddc7-f9b9-4b9e-bbc7-15f71dae6183 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:32.612295 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03deddc7-f9b9-4b9e-bbc7-15f71dae6183 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:32.613132 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03deddc7-f9b9-4b9e-bbc7-15f71dae6183 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:32.613616 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-03deddc7-f9b9-4b9e-bbc7-15f71dae6183 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:32.691421 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-03deddc7-f9b9-4b9e-bbc7-15f71dae6183 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lazy-loading 'services' on Instance uuid 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:29:32.776218 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-03deddc7-f9b9-4b9e-bbc7-15f71dae6183 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/os-volume_attachments/d58140de-6193-45f2-8972-725304e49827" status: 202 len: 0 microversion: 2.20 time: 0.176236 Jan 17 21:29:32.776956 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 512/1017] 10.222.0.64 () {60 vars in 1456 bytes} [Mon Jan 17 21:29:32 2022] DELETE /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/os-volume_attachments/d58140de-6193-45f2-8972-725304e49827 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:29:32.785309 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-781a71e4-7d62-4d12-9154-79ec62400add tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:32.786269 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-781a71e4-7d62-4d12-9154-79ec62400add tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:32.792301 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-781a71e4-7d62-4d12-9154-79ec62400add tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:32.792826 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-781a71e4-7d62-4d12-9154-79ec62400add tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:32.793640 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-781a71e4-7d62-4d12-9154-79ec62400add tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:32.794143 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-781a71e4-7d62-4d12-9154-79ec62400add tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:32.825185 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-781a71e4-7d62-4d12-9154-79ec62400add tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043712 Jan 17 21:29:32.825780 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 506/1018] 10.222.0.64 () {60 vars in 1342 bytes} [Mon Jan 17 21:29:32 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:29:33.838685 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-247756e4-9285-4009-846b-561a14e64351 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:33.839732 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-247756e4-9285-4009-846b-561a14e64351 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:33.846083 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-247756e4-9285-4009-846b-561a14e64351 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:33.846542 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-247756e4-9285-4009-846b-561a14e64351 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:33.847352 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-247756e4-9285-4009-846b-561a14e64351 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:33.847804 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-247756e4-9285-4009-846b-561a14e64351 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:33.878524 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-247756e4-9285-4009-846b-561a14e64351 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044896 Jan 17 21:29:33.879091 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 513/1019] 10.222.0.64 () {60 vars in 1342 bytes} [Mon Jan 17 21:29:33 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:33.937943 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-cd30a372-b5f4-4fd7-8836-b27db845db69 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:33.938490 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-cd30a372-b5f4-4fd7-8836-b27db845db69 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:33.944503 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cd30a372-b5f4-4fd7-8836-b27db845db69 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:33.944962 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cd30a372-b5f4-4fd7-8836-b27db845db69 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:33.945753 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cd30a372-b5f4-4fd7-8836-b27db845db69 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:33.946191 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cd30a372-b5f4-4fd7-8836-b27db845db69 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:33.971725 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-cd30a372-b5f4-4fd7-8836-b27db845db69 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Going to try to terminate instance {{(pid=116183) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:29:34.062132 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-cd30a372-b5f4-4fd7-8836-b27db845db69 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 204 len: 0 microversion: 2.20 time: 0.127665 Jan 17 21:29:34.063130 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 507/1020] 10.222.0.64 () {60 vars in 1279 bytes} [Mon Jan 17 21:29:33 2022] DELETE /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 17 21:29:34.071799 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f917a734-6b91-4b85-ab16-6f8ed92d9d41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:34.072432 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f917a734-6b91-4b85-ab16-6f8ed92d9d41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:34.080917 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f917a734-6b91-4b85-ab16-6f8ed92d9d41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:34.081383 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f917a734-6b91-4b85-ab16-6f8ed92d9d41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:34.082548 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f917a734-6b91-4b85-ab16-6f8ed92d9d41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:34.082967 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f917a734-6b91-4b85-ab16-6f8ed92d9d41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:34.221816 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f917a734-6b91-4b85-ab16-6f8ed92d9d41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:34.229598 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f917a734-6b91-4b85-ab16-6f8ed92d9d41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:34.231087 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f917a734-6b91-4b85-ab16-6f8ed92d9d41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:34.232268 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f917a734-6b91-4b85-ab16-6f8ed92d9d41 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1725 microversion: 2.20 time: 0.164201 Jan 17 21:29:34.232851 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 514/1021] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:29:34 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:29:35.251279 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-64e0eabf-caae-4f27-a049-c29c9833f904 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:35.251894 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-64e0eabf-caae-4f27-a049-c29c9833f904 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:35.258963 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-64e0eabf-caae-4f27-a049-c29c9833f904 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:35.259420 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-64e0eabf-caae-4f27-a049-c29c9833f904 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:35.260222 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-64e0eabf-caae-4f27-a049-c29c9833f904 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:35.260700 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-64e0eabf-caae-4f27-a049-c29c9833f904 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:35.393691 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-64e0eabf-caae-4f27-a049-c29c9833f904 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:35.401759 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-64e0eabf-caae-4f27-a049-c29c9833f904 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:35.403240 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-64e0eabf-caae-4f27-a049-c29c9833f904 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:35.404423 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-64e0eabf-caae-4f27-a049-c29c9833f904 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1725 microversion: 2.20 time: 0.157327 Jan 17 21:29:35.404972 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 508/1022] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:29:35 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:29:36.423012 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6a820d27-eb14-4091-abf5-e45d20f37e32 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:36.423652 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6a820d27-eb14-4091-abf5-e45d20f37e32 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:36.430541 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6a820d27-eb14-4091-abf5-e45d20f37e32 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:36.431360 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6a820d27-eb14-4091-abf5-e45d20f37e32 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:36.432176 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6a820d27-eb14-4091-abf5-e45d20f37e32 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:36.432659 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6a820d27-eb14-4091-abf5-e45d20f37e32 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:36.578941 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6a820d27-eb14-4091-abf5-e45d20f37e32 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:36.587931 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6a820d27-eb14-4091-abf5-e45d20f37e32 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:36.589460 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6a820d27-eb14-4091-abf5-e45d20f37e32 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:36.590633 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6a820d27-eb14-4091-abf5-e45d20f37e32 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 200 len: 1725 microversion: 2.20 time: 0.171452 Jan 17 21:29:36.591454 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 515/1023] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:29:36 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:29:37.099805 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-a53928a9-58de-4e09-9600-594f9a74b1e0 req-dfca1f0f-abcc-4c20-a246-c80e7a10a4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5edb3c99-d30d-4a2c-8b50-5083b7ea9d96", "name": "network-vif-deleted", "tag": "dde4fe76-f1d0-4978-a642-2a35761fdf74"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:37.103114 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:29:37.103114 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:29:37.112215 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-a53928a9-58de-4e09-9600-594f9a74b1e0 req-dfca1f0f-abcc-4c20-a246-c80e7a10a4b4 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:37.112734 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-a53928a9-58de-4e09-9600-594f9a74b1e0 req-dfca1f0f-abcc-4c20-a246-c80e7a10a4b4 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:37.125450 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-a53928a9-58de-4e09-9600-594f9a74b1e0 req-dfca1f0f-abcc-4c20-a246-c80e7a10a4b4 service nova] Creating event network-vif-deleted:dde4fe76-f1d0-4978-a642-2a35761fdf74 for instance 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 on hv-cinder-82489 Jan 17 21:29:37.130663 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-a53928a9-58de-4e09-9600-594f9a74b1e0 req-dfca1f0f-abcc-4c20-a246-c80e7a10a4b4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034494 Jan 17 21:29:37.131926 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 509/1024] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:29:37.610162 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-14ec2a3f-3364-4aed-baf6-957f95df88c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:37.610756 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-14ec2a3f-3364-4aed-baf6-957f95df88c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:37.619221 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-14ec2a3f-3364-4aed-baf6-957f95df88c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:37.619675 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-14ec2a3f-3364-4aed-baf6-957f95df88c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:37.620510 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-14ec2a3f-3364-4aed-baf6-957f95df88c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:37.621649 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-14ec2a3f-3364-4aed-baf6-957f95df88c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:37.636215 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-14ec2a3f-3364-4aed-baf6-957f95df88c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] HTTP exception thrown: Instance 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 could not be found. Jan 17 21:29:37.637058 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-14ec2a3f-3364-4aed-baf6-957f95df88c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Returning 404 to user: Instance 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:29:37.637958 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-14ec2a3f-3364-4aed-baf6-957f95df88c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 404 len: 111 microversion: 2.20 time: 0.031522 Jan 17 21:29:37.638585 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 516/1025] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:29:37 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 17 21:29:37.647470 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f8a7e551-dce1-4445-9293-079d8814c77f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '.version_select at 0x7f897b2ee4c0>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:37.667410 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f8a7e551-dce1-4445-9293-079d8814c77f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1772654283" status: 204 len: 0 microversion: 2.20 time: 0.023801 Jan 17 21:29:37.668347 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 510/1026] 10.222.0.64 () {60 vars in 1261 bytes} [Mon Jan 17 21:29:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1772654283 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 17 21:29:38.401101 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-9ca2820c-7d20-4d34-9031-215b052c533b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'create', calling method: .version_select at 0x7f897697aca0>, body: {"keypair": {"name": "tempest-keypair-16905186"}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:38.415578 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-9ca2820c-7d20-4d34-9031-215b052c533b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Getting quotas for project 3391c884182f46fc99248b8f0ba1822f. Resources: {'key_pairs'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:29:38.419657 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-9ca2820c-7d20-4d34-9031-215b052c533b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Getting quotas for user e157700e929e4e569557016122cf47cf and project 3391c884182f46fc99248b8f0ba1822f. Resources: {'key_pairs'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:29:38.506950 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-9ca2820c-7d20-4d34-9031-215b052c533b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Getting quotas for project 3391c884182f46fc99248b8f0ba1822f. Resources: {'key_pairs'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:29:38.510760 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-9ca2820c-7d20-4d34-9031-215b052c533b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Getting quotas for user e157700e929e4e569557016122cf47cf and project 3391c884182f46fc99248b8f0ba1822f. Resources: {'key_pairs'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:29:38.524276 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-9ca2820c-7d20-4d34-9031-215b052c533b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 2314 microversion: 2.20 time: 0.127589 Jan 17 21:29:38.524921 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 517/1027] 10.222.0.64 () {62 vars in 1198 bytes} [Mon Jan 17 21:29:38 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 17 21:29:39.874706 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-268493621", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0ec84dc-cf63-4d34-bc61-575dee41c738"}], "security_groups": [{"name": "tempest-securitygroup--2146517226"}], "key_name": "tempest-keypair-16905186", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:39.983146 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.network.neutron [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] validate_networks() for [('c0ec84dc-cf63-4d34-bc61-575dee41c738', None, None, None, None, None)] {{(pid=116183) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:29:40.643256 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Flavor limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:29:40.643691 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Image limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:29:40.644282 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Flavor pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:29:40.644737 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Image pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:29:40.645148 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:29:40.657028 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:40.657483 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:40.658297 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:40.658732 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:40.678094 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Getting quotas for project 3391c884182f46fc99248b8f0ba1822f. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:29:40.682216 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Getting quotas for user e157700e929e4e569557016122cf47cf and project 3391c884182f46fc99248b8f0ba1822f. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:29:40.694879 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Going to run 1 instances... {{(pid=116183) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:29:40.697781 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:29:40.748246 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: ERROR oslo.messaging._drivers.impl_rabbit [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [9409995f-39c2-4604-9d5c-243569ad7fe7] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 17 21:29:41.756387 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO oslo.messaging._drivers.impl_rabbit [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [9409995f-39c2-4604-9d5c-243569ad7fe7] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 51992. Jan 17 21:29:41.760749 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-32c7aedb-7a29-4a76-8d75-cfe593d177c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.890681 Jan 17 21:29:41.761610 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 511/1028] 10.222.0.64 () {62 vars in 1187 bytes} [Mon Jan 17 21:29:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 17 21:29:41.827328 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7dd4d980-b20f-492a-abf2-82c68d3a7b25 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:41.828106 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7dd4d980-b20f-492a-abf2-82c68d3a7b25 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:41.884099 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7dd4d980-b20f-492a-abf2-82c68d3a7b25 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:41.892448 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7dd4d980-b20f-492a-abf2-82c68d3a7b25 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:41.894058 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7dd4d980-b20f-492a-abf2-82c68d3a7b25 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:41.895070 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7dd4d980-b20f-492a-abf2-82c68d3a7b25 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1279 microversion: 2.20 time: 0.127595 Jan 17 21:29:41.895664 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 518/1029] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:29:41 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1279 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:29:42.913740 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e288ad2b-6f7e-436c-a3c3-ced738b0e15e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:42.914288 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-e288ad2b-6f7e-436c-a3c3-ced738b0e15e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:42.920741 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e288ad2b-6f7e-436c-a3c3-ced738b0e15e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:42.921334 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e288ad2b-6f7e-436c-a3c3-ced738b0e15e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:42.922337 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e288ad2b-6f7e-436c-a3c3-ced738b0e15e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:42.922872 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e288ad2b-6f7e-436c-a3c3-ced738b0e15e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:42.986410 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-e288ad2b-6f7e-436c-a3c3-ced738b0e15e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:42.994997 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-e288ad2b-6f7e-436c-a3c3-ced738b0e15e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:42.996497 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-e288ad2b-6f7e-436c-a3c3-ced738b0e15e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:42.997622 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e288ad2b-6f7e-436c-a3c3-ced738b0e15e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1337 microversion: 2.20 time: 0.088216 Jan 17 21:29:42.998188 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 512/1030] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:29:42 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1337 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:29:44.022877 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-9fbbbaa4-350d-4592-9132-02c5d363b811 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:44.024124 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-9fbbbaa4-350d-4592-9132-02c5d363b811 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:44.031930 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9fbbbaa4-350d-4592-9132-02c5d363b811 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:44.033828 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9fbbbaa4-350d-4592-9132-02c5d363b811 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:44.034301 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9fbbbaa4-350d-4592-9132-02c5d363b811 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:44.035048 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9fbbbaa4-350d-4592-9132-02c5d363b811 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:44.111074 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-d791ce9d-a3dc-4d6b-8557-2a1e1ee330d2 req-d30465a2-e58f-47a9-98b8-664d7d0f3b7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc3ee12-556d-4522-9fae-d6c208109ee4", "tag": "8aacd03c-92eb-4738-865d-606ef0ff4559"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:44.113343 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:29:44.113343 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:29:44.122338 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-d791ce9d-a3dc-4d6b-8557-2a1e1ee330d2 req-d30465a2-e58f-47a9-98b8-664d7d0f3b7e service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:44.123031 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-d791ce9d-a3dc-4d6b-8557-2a1e1ee330d2 req-d30465a2-e58f-47a9-98b8-664d7d0f3b7e service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:44.135911 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-d791ce9d-a3dc-4d6b-8557-2a1e1ee330d2 req-d30465a2-e58f-47a9-98b8-664d7d0f3b7e service nova] Creating event network-changed:8aacd03c-92eb-4738-865d-606ef0ff4559 for instance 0bc3ee12-556d-4522-9fae-d6c208109ee4 on hv-cinder-82489 Jan 17 21:29:44.141503 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-d791ce9d-a3dc-4d6b-8557-2a1e1ee330d2 req-d30465a2-e58f-47a9-98b8-664d7d0f3b7e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033954 Jan 17 21:29:44.142102 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 513/1031] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:29:44.208130 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-9fbbbaa4-350d-4592-9132-02c5d363b811 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:44.217337 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-9fbbbaa4-350d-4592-9132-02c5d363b811 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:44.218835 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-9fbbbaa4-350d-4592-9132-02c5d363b811 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:44.219945 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-9fbbbaa4-350d-4592-9132-02c5d363b811 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1405 microversion: 2.20 time: 0.202620 Jan 17 21:29:44.220530 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 519/1032] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:29:44 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:29:45.239795 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-93c1def3-6ad7-4499-ad3c-3b1168614322 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:45.240959 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-93c1def3-6ad7-4499-ad3c-3b1168614322 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:45.247055 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-93c1def3-6ad7-4499-ad3c-3b1168614322 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:45.247519 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-93c1def3-6ad7-4499-ad3c-3b1168614322 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:45.248306 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-93c1def3-6ad7-4499-ad3c-3b1168614322 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:45.248774 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-93c1def3-6ad7-4499-ad3c-3b1168614322 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:45.376252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-93c1def3-6ad7-4499-ad3c-3b1168614322 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:45.384498 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-93c1def3-6ad7-4499-ad3c-3b1168614322 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:45.385997 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-93c1def3-6ad7-4499-ad3c-3b1168614322 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:45.387093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-93c1def3-6ad7-4499-ad3c-3b1168614322 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1405 microversion: 2.20 time: 0.152324 Jan 17 21:29:45.387635 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 514/1033] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:29:45 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:29:46.405188 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-29299232-dc01-4316-a817-00fc8a323eda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:46.405833 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-29299232-dc01-4316-a817-00fc8a323eda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:46.412759 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-29299232-dc01-4316-a817-00fc8a323eda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:46.413215 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-29299232-dc01-4316-a817-00fc8a323eda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:46.414035 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-29299232-dc01-4316-a817-00fc8a323eda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:46.414485 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-29299232-dc01-4316-a817-00fc8a323eda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:46.542175 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-29299232-dc01-4316-a817-00fc8a323eda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:46.550090 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-29299232-dc01-4316-a817-00fc8a323eda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:46.551580 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-29299232-dc01-4316-a817-00fc8a323eda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:46.552692 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-29299232-dc01-4316-a817-00fc8a323eda tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1405 microversion: 2.20 time: 0.151272 Jan 17 21:29:46.553295 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 520/1034] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:29:46 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:29:47.571167 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-512c897e-f034-429a-8707-a64a039b7d59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:47.571807 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-512c897e-f034-429a-8707-a64a039b7d59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:47.578396 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-512c897e-f034-429a-8707-a64a039b7d59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:47.578864 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-512c897e-f034-429a-8707-a64a039b7d59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:47.579665 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-512c897e-f034-429a-8707-a64a039b7d59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:47.580103 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-512c897e-f034-429a-8707-a64a039b7d59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:47.712205 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-512c897e-f034-429a-8707-a64a039b7d59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:47.719976 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-512c897e-f034-429a-8707-a64a039b7d59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:47.721527 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-512c897e-f034-429a-8707-a64a039b7d59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:47.722616 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-512c897e-f034-429a-8707-a64a039b7d59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1405 microversion: 2.20 time: 0.155863 Jan 17 21:29:47.723162 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 515/1035] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:29:47 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:29:48.741493 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4c8fc745-43a3-409b-ab26-12de3d4dc0bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:48.742099 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4c8fc745-43a3-409b-ab26-12de3d4dc0bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:48.748525 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c8fc745-43a3-409b-ab26-12de3d4dc0bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:48.748980 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c8fc745-43a3-409b-ab26-12de3d4dc0bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:48.749772 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c8fc745-43a3-409b-ab26-12de3d4dc0bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:48.750209 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c8fc745-43a3-409b-ab26-12de3d4dc0bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:48.898875 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4c8fc745-43a3-409b-ab26-12de3d4dc0bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:48.907089 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4c8fc745-43a3-409b-ab26-12de3d4dc0bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:48.908622 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4c8fc745-43a3-409b-ab26-12de3d4dc0bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:48.909720 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4c8fc745-43a3-409b-ab26-12de3d4dc0bf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1405 microversion: 2.20 time: 0.172588 Jan 17 21:29:48.910275 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 521/1036] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:29:48 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:29:49.928128 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-05b79bd4-d0a9-44ca-a21c-d767e786c62f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:49.928723 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-05b79bd4-d0a9-44ca-a21c-d767e786c62f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:49.935039 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-05b79bd4-d0a9-44ca-a21c-d767e786c62f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:49.935490 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-05b79bd4-d0a9-44ca-a21c-d767e786c62f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:49.936270 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-05b79bd4-d0a9-44ca-a21c-d767e786c62f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:49.936734 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-05b79bd4-d0a9-44ca-a21c-d767e786c62f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:50.083520 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-05b79bd4-d0a9-44ca-a21c-d767e786c62f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:50.092191 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-05b79bd4-d0a9-44ca-a21c-d767e786c62f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:50.093720 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-05b79bd4-d0a9-44ca-a21c-d767e786c62f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:50.094834 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-05b79bd4-d0a9-44ca-a21c-d767e786c62f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1405 microversion: 2.20 time: 0.170544 Jan 17 21:29:50.095374 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 516/1037] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:29:49 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:29:50.627858 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-e7aaf53e-f838-4423-956d-822c95adf8ad req-f4e2a204-205e-410f-87f6-639bb6135e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc3ee12-556d-4522-9fae-d6c208109ee4", "name": "network-vif-plugged", "status": "completed", "tag": "8aacd03c-92eb-4738-865d-606ef0ff4559"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:50.629660 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:29:50.629660 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:29:50.637065 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-e7aaf53e-f838-4423-956d-822c95adf8ad req-f4e2a204-205e-410f-87f6-639bb6135e72 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:50.637610 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-e7aaf53e-f838-4423-956d-822c95adf8ad req-f4e2a204-205e-410f-87f6-639bb6135e72 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:50.649183 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-e7aaf53e-f838-4423-956d-822c95adf8ad req-f4e2a204-205e-410f-87f6-639bb6135e72 service nova] Creating event network-vif-plugged:8aacd03c-92eb-4738-865d-606ef0ff4559 for instance 0bc3ee12-556d-4522-9fae-d6c208109ee4 on hv-cinder-82489 Jan 17 21:29:50.654100 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-e7aaf53e-f838-4423-956d-822c95adf8ad req-f4e2a204-205e-410f-87f6-639bb6135e72 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029853 Jan 17 21:29:50.654850 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 522/1038] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:29:51.112891 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3d6cda42-79cf-467b-aa74-cc219d142850 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:51.113533 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3d6cda42-79cf-467b-aa74-cc219d142850 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:51.120818 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3d6cda42-79cf-467b-aa74-cc219d142850 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:51.121279 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3d6cda42-79cf-467b-aa74-cc219d142850 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:51.122083 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3d6cda42-79cf-467b-aa74-cc219d142850 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:51.122533 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3d6cda42-79cf-467b-aa74-cc219d142850 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:51.261412 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3d6cda42-79cf-467b-aa74-cc219d142850 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:51.269268 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3d6cda42-79cf-467b-aa74-cc219d142850 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:51.270746 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3d6cda42-79cf-467b-aa74-cc219d142850 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:51.271864 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3d6cda42-79cf-467b-aa74-cc219d142850 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1405 microversion: 2.20 time: 0.162919 Jan 17 21:29:51.272647 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 517/1039] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:29:51 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:29:52.291215 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-60720805-7d13-4f57-bc98-74e66f99001c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:52.291878 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-60720805-7d13-4f57-bc98-74e66f99001c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:52.298844 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60720805-7d13-4f57-bc98-74e66f99001c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:52.299314 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60720805-7d13-4f57-bc98-74e66f99001c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:52.300482 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60720805-7d13-4f57-bc98-74e66f99001c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:52.300925 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60720805-7d13-4f57-bc98-74e66f99001c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:52.449752 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-60720805-7d13-4f57-bc98-74e66f99001c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:52.457923 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-60720805-7d13-4f57-bc98-74e66f99001c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:52.460331 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-60720805-7d13-4f57-bc98-74e66f99001c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:29:52.461517 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-60720805-7d13-4f57-bc98-74e66f99001c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1597 microversion: 2.20 time: 0.175752 Jan 17 21:29:52.462080 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 523/1040] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:29:52 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1597 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:29:52.478516 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-15024e69-b7e2-440f-b45e-46c40ad9c32c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:29:52.479787 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-15024e69-b7e2-440f-b45e-46c40ad9c32c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:52.486398 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-15024e69-b7e2-440f-b45e-46c40ad9c32c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:52.486852 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-15024e69-b7e2-440f-b45e-46c40ad9c32c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:52.487661 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-15024e69-b7e2-440f-b45e-46c40ad9c32c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:52.488140 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-15024e69-b7e2-440f-b45e-46c40ad9c32c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:52.567041 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-15024e69-b7e2-440f-b45e-46c40ad9c32c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092196 Jan 17 21:29:52.567627 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 518/1041] 10.222.0.64 () {60 vars in 1315 bytes} [Mon Jan 17 21:29:52 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:29:53.541115 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-4761dc98-f616-447d-8da3-47966a95ede1 req-5b358e8b-553e-48a3-88e3-eeb68244616d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc3ee12-556d-4522-9fae-d6c208109ee4", "tag": "8aacd03c-92eb-4738-865d-606ef0ff4559"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:53.542638 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:29:53.542638 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:29:53.546758 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ac2f31a8-6a5d-43ae-9dca-c9d55f8570f9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:53.547581 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ac2f31a8-6a5d-43ae-9dca-c9d55f8570f9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:53.556479 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-4761dc98-f616-447d-8da3-47966a95ede1 req-5b358e8b-553e-48a3-88e3-eeb68244616d service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:53.557323 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-4761dc98-f616-447d-8da3-47966a95ede1 req-5b358e8b-553e-48a3-88e3-eeb68244616d service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:53.557540 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac2f31a8-6a5d-43ae-9dca-c9d55f8570f9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:53.558374 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac2f31a8-6a5d-43ae-9dca-c9d55f8570f9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:53.559849 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac2f31a8-6a5d-43ae-9dca-c9d55f8570f9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:53.560810 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac2f31a8-6a5d-43ae-9dca-c9d55f8570f9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:53.570742 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-4761dc98-f616-447d-8da3-47966a95ede1 req-5b358e8b-553e-48a3-88e3-eeb68244616d service nova] Creating event network-changed:8aacd03c-92eb-4738-865d-606ef0ff4559 for instance 0bc3ee12-556d-4522-9fae-d6c208109ee4 on hv-cinder-82489 Jan 17 21:29:53.575812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-4761dc98-f616-447d-8da3-47966a95ede1 req-5b358e8b-553e-48a3-88e3-eeb68244616d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039355 Jan 17 21:29:53.576770 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 519/1042] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:29:53.637573 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ac2f31a8-6a5d-43ae-9dca-c9d55f8570f9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 14 microversion: 2.20 time: 0.103833 Jan 17 21:29:53.638147 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 524/1043] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:29:53 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:54.649974 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3fdebb57-f455-499d-b2d2-1f92ea3bd6d7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:54.650920 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3fdebb57-f455-499d-b2d2-1f92ea3bd6d7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:54.657116 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3fdebb57-f455-499d-b2d2-1f92ea3bd6d7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:54.657592 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3fdebb57-f455-499d-b2d2-1f92ea3bd6d7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:54.658369 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3fdebb57-f455-499d-b2d2-1f92ea3bd6d7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:54.658812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3fdebb57-f455-499d-b2d2-1f92ea3bd6d7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:54.720713 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3fdebb57-f455-499d-b2d2-1f92ea3bd6d7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 14 microversion: 2.20 time: 0.075119 Jan 17 21:29:54.721678 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 520/1044] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:29:54 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:55.733003 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-18abae3c-799c-40de-bc62-e5ef4ff7b3f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:55.734005 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-18abae3c-799c-40de-bc62-e5ef4ff7b3f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:55.741777 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-18abae3c-799c-40de-bc62-e5ef4ff7b3f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:55.742232 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-18abae3c-799c-40de-bc62-e5ef4ff7b3f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:55.743013 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-18abae3c-799c-40de-bc62-e5ef4ff7b3f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:55.743448 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-18abae3c-799c-40de-bc62-e5ef4ff7b3f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:55.800987 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-18abae3c-799c-40de-bc62-e5ef4ff7b3f6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 14 microversion: 2.20 time: 0.071942 Jan 17 21:29:55.801591 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 525/1045] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:29:55 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:56.812955 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f5205f20-7de9-4efc-aea8-1516694907d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:56.813971 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f5205f20-7de9-4efc-aea8-1516694907d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:56.820850 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f5205f20-7de9-4efc-aea8-1516694907d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:56.821310 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f5205f20-7de9-4efc-aea8-1516694907d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:56.822100 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f5205f20-7de9-4efc-aea8-1516694907d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:56.822542 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f5205f20-7de9-4efc-aea8-1516694907d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:56.881216 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f5205f20-7de9-4efc-aea8-1516694907d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 14 microversion: 2.20 time: 0.072213 Jan 17 21:29:56.881821 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 521/1046] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:29:56 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:57.892933 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0e2bdb9c-08c2-4a1c-9b71-50a61d8da2ac tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:57.893939 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0e2bdb9c-08c2-4a1c-9b71-50a61d8da2ac tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:57.900829 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0e2bdb9c-08c2-4a1c-9b71-50a61d8da2ac tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:57.901286 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0e2bdb9c-08c2-4a1c-9b71-50a61d8da2ac tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:57.902076 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0e2bdb9c-08c2-4a1c-9b71-50a61d8da2ac tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:57.902521 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0e2bdb9c-08c2-4a1c-9b71-50a61d8da2ac tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:57.959611 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0e2bdb9c-08c2-4a1c-9b71-50a61d8da2ac tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 14 microversion: 2.20 time: 0.070479 Jan 17 21:29:57.962645 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 526/1047] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:29:57 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:29:58.970944 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6b61c349-2706-4e52-a747-57cf94ce6d5b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:29:58.971944 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6b61c349-2706-4e52-a747-57cf94ce6d5b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:29:58.979368 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6b61c349-2706-4e52-a747-57cf94ce6d5b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:58.979828 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6b61c349-2706-4e52-a747-57cf94ce6d5b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:58.980651 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6b61c349-2706-4e52-a747-57cf94ce6d5b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:29:58.981097 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6b61c349-2706-4e52-a747-57cf94ce6d5b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:29:59.041709 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6b61c349-2706-4e52-a747-57cf94ce6d5b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 14 microversion: 2.20 time: 0.074731 Jan 17 21:29:59.042316 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 522/1048] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:29:58 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:30:00.053872 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f64bb65f-5bce-4d16-8391-52dbc3e208d9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:00.054883 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f64bb65f-5bce-4d16-8391-52dbc3e208d9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:00.062114 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f64bb65f-5bce-4d16-8391-52dbc3e208d9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:00.062578 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f64bb65f-5bce-4d16-8391-52dbc3e208d9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:00.063381 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f64bb65f-5bce-4d16-8391-52dbc3e208d9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:00.063844 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f64bb65f-5bce-4d16-8391-52dbc3e208d9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:00.128669 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f64bb65f-5bce-4d16-8391-52dbc3e208d9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 14 microversion: 2.20 time: 0.079354 Jan 17 21:30:00.129330 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 527/1049] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:00 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:30:01.140662 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-15f3f0ee-da37-4d6e-87b4-0e83c92a85e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:01.141667 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-15f3f0ee-da37-4d6e-87b4-0e83c92a85e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:01.148647 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-15f3f0ee-da37-4d6e-87b4-0e83c92a85e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:01.149108 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-15f3f0ee-da37-4d6e-87b4-0e83c92a85e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:01.149900 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-15f3f0ee-da37-4d6e-87b4-0e83c92a85e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:01.150346 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-15f3f0ee-da37-4d6e-87b4-0e83c92a85e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:01.229671 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-15f3f0ee-da37-4d6e-87b4-0e83c92a85e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 14 microversion: 2.20 time: 0.092951 Jan 17 21:30:01.230280 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 523/1050] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:01 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:30:02.242024 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8e00c8ea-f8da-4651-84cb-77fda7c7f7fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:02.242935 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8e00c8ea-f8da-4651-84cb-77fda7c7f7fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:02.249831 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8e00c8ea-f8da-4651-84cb-77fda7c7f7fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:02.250298 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8e00c8ea-f8da-4651-84cb-77fda7c7f7fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:02.251089 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8e00c8ea-f8da-4651-84cb-77fda7c7f7fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:02.251532 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8e00c8ea-f8da-4651-84cb-77fda7c7f7fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:02.318660 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8e00c8ea-f8da-4651-84cb-77fda7c7f7fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 14 microversion: 2.20 time: 0.080537 Jan 17 21:30:02.319316 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 528/1051] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:02 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:30:03.330127 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-bfa1b001-e6d7-47ed-ad4e-f658a0f80a93 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:03.331105 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-bfa1b001-e6d7-47ed-ad4e-f658a0f80a93 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:03.338800 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bfa1b001-e6d7-47ed-ad4e-f658a0f80a93 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:03.339253 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bfa1b001-e6d7-47ed-ad4e-f658a0f80a93 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:03.340051 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bfa1b001-e6d7-47ed-ad4e-f658a0f80a93 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:03.340526 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bfa1b001-e6d7-47ed-ad4e-f658a0f80a93 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:03.404542 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-bfa1b001-e6d7-47ed-ad4e-f658a0f80a93 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 14 microversion: 2.20 time: 0.078375 Jan 17 21:30:03.405427 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 524/1052] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:03 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:30:04.416273 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-469ac76e-3dea-4d50-8b95-87aa1b450a88 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:04.417297 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-469ac76e-3dea-4d50-8b95-87aa1b450a88 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:04.424168 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-469ac76e-3dea-4d50-8b95-87aa1b450a88 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:04.424649 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-469ac76e-3dea-4d50-8b95-87aa1b450a88 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:04.425436 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-469ac76e-3dea-4d50-8b95-87aa1b450a88 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:04.425872 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-469ac76e-3dea-4d50-8b95-87aa1b450a88 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:04.488972 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-469ac76e-3dea-4d50-8b95-87aa1b450a88 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 14 microversion: 2.20 time: 0.076580 Jan 17 21:30:04.490413 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 529/1053] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:04 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:30:05.501315 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-942c7522-0b68-4e82-90eb-0f9cdaf7338c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:05.502317 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-942c7522-0b68-4e82-90eb-0f9cdaf7338c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:05.509821 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-942c7522-0b68-4e82-90eb-0f9cdaf7338c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:05.510280 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-942c7522-0b68-4e82-90eb-0f9cdaf7338c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:05.511079 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-942c7522-0b68-4e82-90eb-0f9cdaf7338c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:05.511529 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-942c7522-0b68-4e82-90eb-0f9cdaf7338c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:05.595008 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-942c7522-0b68-4e82-90eb-0f9cdaf7338c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 7599 microversion: 2.20 time: 0.097680 Jan 17 21:30:05.595644 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 525/1054] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:05 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 7599 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:30:06.607234 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f879a698-2f90-4219-9139-a16630403435 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:06.608247 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f879a698-2f90-4219-9139-a16630403435 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:06.617045 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f879a698-2f90-4219-9139-a16630403435 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:06.617574 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f879a698-2f90-4219-9139-a16630403435 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:06.618380 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f879a698-2f90-4219-9139-a16630403435 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:06.618834 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f879a698-2f90-4219-9139-a16630403435 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:06.693898 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f879a698-2f90-4219-9139-a16630403435 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 15025 microversion: 2.20 time: 0.090599 Jan 17 21:30:06.694520 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 530/1055] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:06 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 15025 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:07.705648 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-663ae285-7fba-4d34-a897-59653e80cc59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:07.707246 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-663ae285-7fba-4d34-a897-59653e80cc59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:07.714849 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-663ae285-7fba-4d34-a897-59653e80cc59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:07.715309 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-663ae285-7fba-4d34-a897-59653e80cc59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:07.716103 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-663ae285-7fba-4d34-a897-59653e80cc59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:07.716575 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-663ae285-7fba-4d34-a897-59653e80cc59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:07.819704 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-663ae285-7fba-4d34-a897-59653e80cc59 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 18498 microversion: 2.20 time: 0.117897 Jan 17 21:30:07.820346 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 526/1056] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:07 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 18498 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:08.832313 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1c38ced0-9b64-4c3a-8674-a1ad63ef0ce5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:08.833262 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1c38ced0-9b64-4c3a-8674-a1ad63ef0ce5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:08.840574 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c38ced0-9b64-4c3a-8674-a1ad63ef0ce5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:08.841041 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c38ced0-9b64-4c3a-8674-a1ad63ef0ce5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:08.841841 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c38ced0-9b64-4c3a-8674-a1ad63ef0ce5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:08.842286 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c38ced0-9b64-4c3a-8674-a1ad63ef0ce5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:08.930686 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1c38ced0-9b64-4c3a-8674-a1ad63ef0ce5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 19342 microversion: 2.20 time: 0.102706 Jan 17 21:30:08.931624 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 531/1057] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:08 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 19342 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:30:09.942917 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9eda467a-7d6e-4b2c-b1ee-e5b3c801041f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:09.943922 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-9eda467a-7d6e-4b2c-b1ee-e5b3c801041f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:09.951553 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9eda467a-7d6e-4b2c-b1ee-e5b3c801041f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:09.952008 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9eda467a-7d6e-4b2c-b1ee-e5b3c801041f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:09.952830 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9eda467a-7d6e-4b2c-b1ee-e5b3c801041f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:09.953265 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9eda467a-7d6e-4b2c-b1ee-e5b3c801041f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:10.034049 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-9eda467a-7d6e-4b2c-b1ee-e5b3c801041f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 22200 microversion: 2.20 time: 0.095067 Jan 17 21:30:10.034712 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 527/1058] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:09 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 22200 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:11.047175 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a1ff8bc9-c7a9-48a2-a4c7-88b83707cbfb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:11.048195 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a1ff8bc9-c7a9-48a2-a4c7-88b83707cbfb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:11.055496 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a1ff8bc9-c7a9-48a2-a4c7-88b83707cbfb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:11.055956 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a1ff8bc9-c7a9-48a2-a4c7-88b83707cbfb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:11.056803 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a1ff8bc9-c7a9-48a2-a4c7-88b83707cbfb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:11.057254 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a1ff8bc9-c7a9-48a2-a4c7-88b83707cbfb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:11.143579 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a1ff8bc9-c7a9-48a2-a4c7-88b83707cbfb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 23659 microversion: 2.20 time: 0.100431 Jan 17 21:30:11.144500 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 532/1059] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:11 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 23659 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:12.156424 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5089dc7d-9c4a-4d88-9b92-ffa279f71447 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:12.157436 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5089dc7d-9c4a-4d88-9b92-ffa279f71447 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:12.165075 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5089dc7d-9c4a-4d88-9b92-ffa279f71447 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:12.165531 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5089dc7d-9c4a-4d88-9b92-ffa279f71447 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:12.166334 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5089dc7d-9c4a-4d88-9b92-ffa279f71447 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:12.166771 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5089dc7d-9c4a-4d88-9b92-ffa279f71447 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:12.241595 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5089dc7d-9c4a-4d88-9b92-ffa279f71447 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 24944 microversion: 2.20 time: 0.088956 Jan 17 21:30:12.242146 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 528/1060] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:12 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 24944 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:12.550826 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c0c4821e-6e53-4371-91bf-c02cf4eff22c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-517440629"}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:12.552142 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c0c4821e-6e53-4371-91bf-c02cf4eff22c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:12.559467 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c0c4821e-6e53-4371-91bf-c02cf4eff22c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:12.559923 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c0c4821e-6e53-4371-91bf-c02cf4eff22c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:12.560791 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c0c4821e-6e53-4371-91bf-c02cf4eff22c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:12.561245 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c0c4821e-6e53-4371-91bf-c02cf4eff22c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:12.693796 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.network.security_group_api [None req-c0c4821e-6e53-4371-91bf-c02cf4eff22c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Removing security group a1a863a3-d208-4bbc-be40-7af063b28fb8 from port 8071f514-88c2-4831-9268-624212bd59d9 Jan 17 21:30:13.062007 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c0c4821e-6e53-4371-91bf-c02cf4eff22c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "POST /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/action" status: 202 len: 0 microversion: 2.1 time: 0.515303 Jan 17 21:30:13.068904 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 533/1061] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:30:12 2022] POST /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:13.079245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-76d9b348-5b2d-45f6-b176-4d89e66ef857 req-881c4c76-4cc7-4267-9726-2734163a7a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750a4c55-b8a2-4303-a261-db81409d8b93", "tag": "8071f514-88c2-4831-9268-624212bd59d9"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:13.081864 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:30:13.081864 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:30:13.095727 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-76d9b348-5b2d-45f6-b176-4d89e66ef857 req-881c4c76-4cc7-4267-9726-2734163a7a1f service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:13.096709 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-76d9b348-5b2d-45f6-b176-4d89e66ef857 req-881c4c76-4cc7-4267-9726-2734163a7a1f service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:13.112172 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-76d9b348-5b2d-45f6-b176-4d89e66ef857 req-881c4c76-4cc7-4267-9726-2734163a7a1f service nova] Creating event network-changed:8071f514-88c2-4831-9268-624212bd59d9 for instance 750a4c55-b8a2-4303-a261-db81409d8b93 on hv-cinder-82489 Jan 17 21:30:13.117820 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-76d9b348-5b2d-45f6-b176-4d89e66ef857 req-881c4c76-4cc7-4267-9726-2734163a7a1f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044645 Jan 17 21:30:13.118596 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 529/1062] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:30:13.255654 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d21fd357-6c5e-48d5-900f-936a0603c3ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:13.257126 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d21fd357-6c5e-48d5-900f-936a0603c3ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:13.266710 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d21fd357-6c5e-48d5-900f-936a0603c3ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:13.267550 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d21fd357-6c5e-48d5-900f-936a0603c3ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:13.269580 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d21fd357-6c5e-48d5-900f-936a0603c3ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:13.271568 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d21fd357-6c5e-48d5-900f-936a0603c3ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:13.382738 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d21fd357-6c5e-48d5-900f-936a0603c3ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 26371 microversion: 2.20 time: 0.132301 Jan 17 21:30:13.387090 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 534/1063] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:13 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 26371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:14.399642 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f53018e2-3f59-4d7d-b07e-9e7e53f0e7a8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:14.401218 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f53018e2-3f59-4d7d-b07e-9e7e53f0e7a8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:14.409400 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f53018e2-3f59-4d7d-b07e-9e7e53f0e7a8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:14.409861 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f53018e2-3f59-4d7d-b07e-9e7e53f0e7a8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:14.411325 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f53018e2-3f59-4d7d-b07e-9e7e53f0e7a8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:14.412309 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f53018e2-3f59-4d7d-b07e-9e7e53f0e7a8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:14.427832 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-44658810-eb92-43ad-ac60-967d7220f8d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:14.428442 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-44658810-eb92-43ad-ac60-967d7220f8d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:14.435363 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-44658810-eb92-43ad-ac60-967d7220f8d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:14.435827 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-44658810-eb92-43ad-ac60-967d7220f8d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:14.436684 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-44658810-eb92-43ad-ac60-967d7220f8d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:14.437431 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-44658810-eb92-43ad-ac60-967d7220f8d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:14.502932 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f53018e2-3f59-4d7d-b07e-9e7e53f0e7a8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 27424 microversion: 2.20 time: 0.109139 Jan 17 21:30:14.503868 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 530/1064] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:14 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 27424 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:14.646012 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-44658810-eb92-43ad-ac60-967d7220f8d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lazy-loading 'services' on Instance uuid 750a4c55-b8a2-4303-a261-db81409d8b93 {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:30:14.727630 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-44658810-eb92-43ad-ac60-967d7220f8d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "DELETE /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/os-volume_attachments/9af4222d-3dd3-46a3-973d-e0af6b680526" status: 202 len: 0 microversion: 2.1 time: 0.304150 Jan 17 21:30:14.728244 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 535/1065] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jan 17 21:30:14 2022] DELETE /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/os-volume_attachments/9af4222d-3dd3-46a3-973d-e0af6b680526 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:30:14.742387 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-08a76640-af2b-4c8f-bc01-c352e2a6928e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:14.744582 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-08a76640-af2b-4c8f-bc01-c352e2a6928e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:14.756525 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-08a76640-af2b-4c8f-bc01-c352e2a6928e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:14.757592 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-08a76640-af2b-4c8f-bc01-c352e2a6928e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:14.758558 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-08a76640-af2b-4c8f-bc01-c352e2a6928e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:14.759086 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-08a76640-af2b-4c8f-bc01-c352e2a6928e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:14.804671 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-08a76640-af2b-4c8f-bc01-c352e2a6928e tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070216 Jan 17 21:30:14.805334 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 531/1066] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:30:14 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:30:15.135880 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-3fadd5ef-ba1f-45e0-839e-64cba298f0ab req-c83c3383-3d29-45ad-abc4-fb4aede3c4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750a4c55-b8a2-4303-a261-db81409d8b93", "tag": "8071f514-88c2-4831-9268-624212bd59d9"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:15.137525 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:30:15.137525 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:30:15.145921 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-3fadd5ef-ba1f-45e0-839e-64cba298f0ab req-c83c3383-3d29-45ad-abc4-fb4aede3c4e1 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:15.146371 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-3fadd5ef-ba1f-45e0-839e-64cba298f0ab req-c83c3383-3d29-45ad-abc4-fb4aede3c4e1 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:15.158532 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-3fadd5ef-ba1f-45e0-839e-64cba298f0ab req-c83c3383-3d29-45ad-abc4-fb4aede3c4e1 service nova] Creating event network-changed:8071f514-88c2-4831-9268-624212bd59d9 for instance 750a4c55-b8a2-4303-a261-db81409d8b93 on hv-cinder-82489 Jan 17 21:30:15.163652 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-3fadd5ef-ba1f-45e0-839e-64cba298f0ab req-c83c3383-3d29-45ad-abc4-fb4aede3c4e1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031781 Jan 17 21:30:15.164664 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 536/1067] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:30:15.515682 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-117b5bc5-0937-469b-8c67-d143806c6e9f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:15.517348 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-117b5bc5-0937-469b-8c67-d143806c6e9f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:15.523913 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-117b5bc5-0937-469b-8c67-d143806c6e9f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:15.524455 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-117b5bc5-0937-469b-8c67-d143806c6e9f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:15.525272 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-117b5bc5-0937-469b-8c67-d143806c6e9f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:15.525754 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-117b5bc5-0937-469b-8c67-d143806c6e9f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:15.607646 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-117b5bc5-0937-469b-8c67-d143806c6e9f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 27812 microversion: 2.20 time: 0.096086 Jan 17 21:30:15.608304 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 532/1068] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:15 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 27812 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:15.816923 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c31fa5a7-f957-4f71-ba1f-87ab33d53881 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:15.817936 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c31fa5a7-f957-4f71-ba1f-87ab33d53881 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:15.824467 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c31fa5a7-f957-4f71-ba1f-87ab33d53881 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:15.824933 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c31fa5a7-f957-4f71-ba1f-87ab33d53881 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:15.825771 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c31fa5a7-f957-4f71-ba1f-87ab33d53881 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:15.826549 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c31fa5a7-f957-4f71-ba1f-87ab33d53881 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:15.858380 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c31fa5a7-f957-4f71-ba1f-87ab33d53881 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046142 Jan 17 21:30:15.858971 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 537/1069] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:30:15 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:30:15.869459 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-98eafe6f-7276-45eb-b2e8-d6a6920adf3d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:15.870041 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-98eafe6f-7276-45eb-b2e8-d6a6920adf3d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:15.876992 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-98eafe6f-7276-45eb-b2e8-d6a6920adf3d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:15.877455 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-98eafe6f-7276-45eb-b2e8-d6a6920adf3d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:15.878253 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-98eafe6f-7276-45eb-b2e8-d6a6920adf3d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:15.878692 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-98eafe6f-7276-45eb-b2e8-d6a6920adf3d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:16.012987 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-98eafe6f-7276-45eb-b2e8-d6a6920adf3d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] HTTP exception thrown: Instance 750a4c55-b8a2-4303-a261-db81409d8b93 is not attached to volume 9af4222d-3dd3-46a3-973d-e0af6b680526 Jan 17 21:30:16.013597 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-98eafe6f-7276-45eb-b2e8-d6a6920adf3d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Returning 404 to user: Instance 750a4c55-b8a2-4303-a261-db81409d8b93 is not attached to volume 9af4222d-3dd3-46a3-973d-e0af6b680526 {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:30:16.014437 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-98eafe6f-7276-45eb-b2e8-d6a6920adf3d tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "DELETE /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/os-volume_attachments/9af4222d-3dd3-46a3-973d-e0af6b680526" status: 404 len: 154 microversion: 2.1 time: 0.149252 Jan 17 21:30:16.014982 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 533/1070] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jan 17 21:30:15 2022] DELETE /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93/os-volume_attachments/9af4222d-3dd3-46a3-973d-e0af6b680526 => generated 154 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 17 21:30:16.621063 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-bf5f2416-e459-491c-89ff-9b674c2b2fb3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:16.621988 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-bf5f2416-e459-491c-89ff-9b674c2b2fb3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:16.628040 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bf5f2416-e459-491c-89ff-9b674c2b2fb3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:16.628461 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bf5f2416-e459-491c-89ff-9b674c2b2fb3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:16.629831 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bf5f2416-e459-491c-89ff-9b674c2b2fb3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:16.630299 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bf5f2416-e459-491c-89ff-9b674c2b2fb3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:16.703539 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-bf5f2416-e459-491c-89ff-9b674c2b2fb3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28235 microversion: 2.20 time: 0.086974 Jan 17 21:30:16.704198 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 538/1071] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:16 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28235 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:17.142478 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-24547935-9cbc-4082-b490-8f4b345fd45c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:17.143039 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-24547935-9cbc-4082-b490-8f4b345fd45c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:17.150154 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24547935-9cbc-4082-b490-8f4b345fd45c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:17.150607 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24547935-9cbc-4082-b490-8f4b345fd45c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:17.151392 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24547935-9cbc-4082-b490-8f4b345fd45c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:17.151850 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24547935-9cbc-4082-b490-8f4b345fd45c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:17.179206 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-24547935-9cbc-4082-b490-8f4b345fd45c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Going to try to terminate instance {{(pid=116183) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:30:17.262832 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-24547935-9cbc-4082-b490-8f4b345fd45c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "DELETE /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 204 len: 0 microversion: 2.1 time: 0.124045 Jan 17 21:30:17.263347 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 534/1072] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:30:17 2022] DELETE /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:30:17.273717 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b1e8fbe5-6595-475b-8111-b956c6be162b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:17.274428 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b1e8fbe5-6595-475b-8111-b956c6be162b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:17.281443 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b1e8fbe5-6595-475b-8111-b956c6be162b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:17.281901 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b1e8fbe5-6595-475b-8111-b956c6be162b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:17.282703 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b1e8fbe5-6595-475b-8111-b956c6be162b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:17.283183 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b1e8fbe5-6595-475b-8111-b956c6be162b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:17.420750 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b1e8fbe5-6595-475b-8111-b956c6be162b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:30:17.428438 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b1e8fbe5-6595-475b-8111-b956c6be162b tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1553 microversion: 2.1 time: 0.159256 Jan 17 21:30:17.429023 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 539/1073] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:30:17 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:30:17.716140 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d115283f-3495-44a9-bef5-c8ab0902e24d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:17.717169 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d115283f-3495-44a9-bef5-c8ab0902e24d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:17.723547 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d115283f-3495-44a9-bef5-c8ab0902e24d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:17.724004 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d115283f-3495-44a9-bef5-c8ab0902e24d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:17.724827 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d115283f-3495-44a9-bef5-c8ab0902e24d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:17.725272 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d115283f-3495-44a9-bef5-c8ab0902e24d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:17.797133 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d115283f-3495-44a9-bef5-c8ab0902e24d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28235 microversion: 2.20 time: 0.084532 Jan 17 21:30:17.797483 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 535/1074] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:17 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28235 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:18.445453 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-99389dbf-a398-4c48-8c91-fcbd8793501c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:18.446047 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-99389dbf-a398-4c48-8c91-fcbd8793501c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:18.452443 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99389dbf-a398-4c48-8c91-fcbd8793501c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:18.452906 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99389dbf-a398-4c48-8c91-fcbd8793501c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:18.453697 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99389dbf-a398-4c48-8c91-fcbd8793501c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:18.454131 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99389dbf-a398-4c48-8c91-fcbd8793501c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:18.594914 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-99389dbf-a398-4c48-8c91-fcbd8793501c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:30:18.602585 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-99389dbf-a398-4c48-8c91-fcbd8793501c tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1553 microversion: 2.1 time: 0.160845 Jan 17 21:30:18.603163 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 540/1075] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:30:18 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:30:18.811471 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-20577c61-87f7-4858-822b-b870a0cea5dd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:18.812453 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-20577c61-87f7-4858-822b-b870a0cea5dd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:18.823122 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-20577c61-87f7-4858-822b-b870a0cea5dd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:18.823582 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-20577c61-87f7-4858-822b-b870a0cea5dd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:18.824434 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-20577c61-87f7-4858-822b-b870a0cea5dd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:18.824885 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-20577c61-87f7-4858-822b-b870a0cea5dd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:18.890634 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-20577c61-87f7-4858-822b-b870a0cea5dd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28235 microversion: 2.20 time: 0.085014 Jan 17 21:30:18.891289 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 536/1076] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:18 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28235 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:19.619858 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3518926e-cc63-4eba-89aa-875a70e5c6ed tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:19.620538 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-3518926e-cc63-4eba-89aa-875a70e5c6ed tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:19.627304 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3518926e-cc63-4eba-89aa-875a70e5c6ed tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:19.627774 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3518926e-cc63-4eba-89aa-875a70e5c6ed tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:19.628653 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3518926e-cc63-4eba-89aa-875a70e5c6ed tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:19.629116 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3518926e-cc63-4eba-89aa-875a70e5c6ed tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:19.902918 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b1886f2b-7a75-449f-adaf-7166ee64353a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:19.904644 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b1886f2b-7a75-449f-adaf-7166ee64353a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:19.924118 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b1886f2b-7a75-449f-adaf-7166ee64353a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:19.924652 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b1886f2b-7a75-449f-adaf-7166ee64353a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:19.925579 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b1886f2b-7a75-449f-adaf-7166ee64353a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:19.926101 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b1886f2b-7a75-449f-adaf-7166ee64353a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:20.023014 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b1886f2b-7a75-449f-adaf-7166ee64353a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28235 microversion: 2.20 time: 0.124175 Jan 17 21:30:20.023694 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 537/1077] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:19 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28235 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:30:20.029364 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-9c147874-e8dd-4f5f-a0dd-610dea936bf5 req-b6c5fbbf-ddc1-45cb-bee2-26670f31e89a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750a4c55-b8a2-4303-a261-db81409d8b93", "name": "network-vif-deleted", "tag": "8071f514-88c2-4831-9268-624212bd59d9"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:20.031269 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:30:20.031269 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:30:20.039972 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-9c147874-e8dd-4f5f-a0dd-610dea936bf5 req-b6c5fbbf-ddc1-45cb-bee2-26670f31e89a service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:20.040432 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-9c147874-e8dd-4f5f-a0dd-610dea936bf5 req-b6c5fbbf-ddc1-45cb-bee2-26670f31e89a service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:20.052491 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-9c147874-e8dd-4f5f-a0dd-610dea936bf5 req-b6c5fbbf-ddc1-45cb-bee2-26670f31e89a service nova] Creating event network-vif-deleted:8071f514-88c2-4831-9268-624212bd59d9 for instance 750a4c55-b8a2-4303-a261-db81409d8b93 on hv-cinder-82489 Jan 17 21:30:20.058392 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-9c147874-e8dd-4f5f-a0dd-610dea936bf5 req-b6c5fbbf-ddc1-45cb-bee2-26670f31e89a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032744 Jan 17 21:30:20.059385 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 538/1078] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:30:20.075558 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-3518926e-cc63-4eba-89aa-875a70e5c6ed tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'febaa74bf52c40069395b85df46767f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33682ba1d2ed4a519d30f654b5d9b876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:30:20.084475 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3518926e-cc63-4eba-89aa-875a70e5c6ed tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 200 len: 1553 microversion: 2.1 time: 0.468859 Jan 17 21:30:20.085051 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 541/1079] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:30:19 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 1553 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:30:21.036219 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a8b722e6-92c0-41b9-a0c3-8449b31a4cc9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:21.037233 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a8b722e6-92c0-41b9-a0c3-8449b31a4cc9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:21.043743 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a8b722e6-92c0-41b9-a0c3-8449b31a4cc9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:21.044186 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a8b722e6-92c0-41b9-a0c3-8449b31a4cc9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:21.045015 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a8b722e6-92c0-41b9-a0c3-8449b31a4cc9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:21.045455 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a8b722e6-92c0-41b9-a0c3-8449b31a4cc9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:21.100825 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c41b36db-8c23-4fe1-9ca9-f091f4c021d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:21.101544 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c41b36db-8c23-4fe1-9ca9-f091f4c021d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] [instance: 750a4c55-b8a2-4303-a261-db81409d8b93] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:21.108109 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c41b36db-8c23-4fe1-9ca9-f091f4c021d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:21.108613 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c41b36db-8c23-4fe1-9ca9-f091f4c021d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:21.109415 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c41b36db-8c23-4fe1-9ca9-f091f4c021d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:21.109887 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c41b36db-8c23-4fe1-9ca9-f091f4c021d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:21.114882 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a8b722e6-92c0-41b9-a0c3-8449b31a4cc9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28235 microversion: 2.20 time: 0.083071 Jan 17 21:30:21.118990 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 539/1080] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:21 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28235 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:21.126463 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-c41b36db-8c23-4fe1-9ca9-f091f4c021d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] HTTP exception thrown: Instance 750a4c55-b8a2-4303-a261-db81409d8b93 could not be found. Jan 17 21:30:21.127129 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c41b36db-8c23-4fe1-9ca9-f091f4c021d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Returning 404 to user: Instance 750a4c55-b8a2-4303-a261-db81409d8b93 could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:30:21.128074 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c41b36db-8c23-4fe1-9ca9-f091f4c021d8 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93" status: 404 len: 111 microversion: 2.1 time: 0.031134 Jan 17 21:30:21.128776 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 542/1081] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:30:21 2022] GET /compute/v2.1/servers/750a4c55-b8a2-4303-a261-db81409d8b93 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 17 21:30:21.138103 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ad3c8fc9-2f45-477c-85b7-e4b573073710 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] Calling method '.version_select at 0x7f89769a0280>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:21.156597 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ad3c8fc9-2f45-477c-85b7-e4b573073710 tempest-TestMinimumBasicScenario-1619913252 tempest-TestMinimumBasicScenario-1619913252-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-725386759" status: 202 len: 0 microversion: 2.1 time: 0.022238 Jan 17 21:30:21.157449 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 540/1082] 10.222.0.64 () {58 vars in 1268 bytes} [Mon Jan 17 21:30:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-725386759 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:22.128295 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8316f7f9-6509-4224-8b9f-ebffa2fdc35b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:22.130162 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8316f7f9-6509-4224-8b9f-ebffa2fdc35b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:22.139837 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8316f7f9-6509-4224-8b9f-ebffa2fdc35b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:22.140300 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8316f7f9-6509-4224-8b9f-ebffa2fdc35b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:22.141202 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8316f7f9-6509-4224-8b9f-ebffa2fdc35b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:22.141648 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8316f7f9-6509-4224-8b9f-ebffa2fdc35b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:22.211492 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8316f7f9-6509-4224-8b9f-ebffa2fdc35b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28235 microversion: 2.20 time: 0.087920 Jan 17 21:30:22.212152 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 543/1083] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:22 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28235 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:23.225283 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0136a6ef-9fce-4756-84c0-25178fdbc536 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:23.226558 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-0136a6ef-9fce-4756-84c0-25178fdbc536 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:23.234826 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0136a6ef-9fce-4756-84c0-25178fdbc536 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:23.235345 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0136a6ef-9fce-4756-84c0-25178fdbc536 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:23.236106 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0136a6ef-9fce-4756-84c0-25178fdbc536 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:23.236858 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0136a6ef-9fce-4756-84c0-25178fdbc536 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:23.310422 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-0136a6ef-9fce-4756-84c0-25178fdbc536 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28235 microversion: 2.20 time: 0.089986 Jan 17 21:30:23.312355 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 541/1084] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:23 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28235 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:30:24.324175 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c747de75-a74d-464b-9b9c-a294a77bfec8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:24.324967 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c747de75-a74d-464b-9b9c-a294a77bfec8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:24.334926 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c747de75-a74d-464b-9b9c-a294a77bfec8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:24.335422 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c747de75-a74d-464b-9b9c-a294a77bfec8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:24.336318 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c747de75-a74d-464b-9b9c-a294a77bfec8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:24.336802 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c747de75-a74d-464b-9b9c-a294a77bfec8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:24.404902 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c747de75-a74d-464b-9b9c-a294a77bfec8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28235 microversion: 2.20 time: 0.085037 Jan 17 21:30:24.405602 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 544/1085] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:24 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28235 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:25.423042 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-17909029-08f2-45d8-b8ed-cd624515c3bd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:25.424871 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-17909029-08f2-45d8-b8ed-cd624515c3bd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:25.436202 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17909029-08f2-45d8-b8ed-cd624515c3bd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:25.436695 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17909029-08f2-45d8-b8ed-cd624515c3bd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:25.437609 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17909029-08f2-45d8-b8ed-cd624515c3bd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:25.438044 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17909029-08f2-45d8-b8ed-cd624515c3bd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:25.508056 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-17909029-08f2-45d8-b8ed-cd624515c3bd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28235 microversion: 2.20 time: 0.092438 Jan 17 21:30:25.508751 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 542/1086] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:25 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28235 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:26.520087 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-62f6e074-e861-4817-9d46-746a37a77732 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:26.521142 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-62f6e074-e861-4817-9d46-746a37a77732 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:26.527967 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-62f6e074-e861-4817-9d46-746a37a77732 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:26.528458 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-62f6e074-e861-4817-9d46-746a37a77732 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:26.529364 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-62f6e074-e861-4817-9d46-746a37a77732 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:26.529715 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-62f6e074-e861-4817-9d46-746a37a77732 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:26.595030 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-62f6e074-e861-4817-9d46-746a37a77732 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28235 microversion: 2.20 time: 0.079236 Jan 17 21:30:26.595663 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 545/1087] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:26 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28235 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:27.608896 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d314b654-aa1f-4a20-a983-76e71bdd410c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:27.610149 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d314b654-aa1f-4a20-a983-76e71bdd410c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:27.620426 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d314b654-aa1f-4a20-a983-76e71bdd410c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:27.620883 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d314b654-aa1f-4a20-a983-76e71bdd410c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:27.621725 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d314b654-aa1f-4a20-a983-76e71bdd410c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:27.622317 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d314b654-aa1f-4a20-a983-76e71bdd410c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:27.734386 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d314b654-aa1f-4a20-a983-76e71bdd410c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28235 microversion: 2.20 time: 0.129503 Jan 17 21:30:27.735326 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 543/1088] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:27 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28235 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:28.754076 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ca3b61bd-8140-4a0d-9776-d2c928aa322c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:28.757879 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ca3b61bd-8140-4a0d-9776-d2c928aa322c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:28.774989 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca3b61bd-8140-4a0d-9776-d2c928aa322c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:28.775648 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca3b61bd-8140-4a0d-9776-d2c928aa322c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:28.777024 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca3b61bd-8140-4a0d-9776-d2c928aa322c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:28.778091 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca3b61bd-8140-4a0d-9776-d2c928aa322c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:28.903778 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ca3b61bd-8140-4a0d-9776-d2c928aa322c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28430 microversion: 2.20 time: 0.156419 Jan 17 21:30:28.905893 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 546/1089] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:28 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28430 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:30:29.920082 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1e9521f6-6f1f-402c-82f9-762b9dceddff tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:29.921787 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1e9521f6-6f1f-402c-82f9-762b9dceddff tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:29.931991 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1e9521f6-6f1f-402c-82f9-762b9dceddff tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:29.932497 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1e9521f6-6f1f-402c-82f9-762b9dceddff tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:29.933739 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1e9521f6-6f1f-402c-82f9-762b9dceddff tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:29.934807 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1e9521f6-6f1f-402c-82f9-762b9dceddff tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:30.019991 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1e9521f6-6f1f-402c-82f9-762b9dceddff tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28526 microversion: 2.20 time: 0.106476 Jan 17 21:30:30.021999 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 544/1090] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:29 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28526 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:31.033011 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-74207513-d277-4158-a20f-2967fc4eb45f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:31.034048 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-74207513-d277-4158-a20f-2967fc4eb45f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:31.041677 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-74207513-d277-4158-a20f-2967fc4eb45f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:31.042147 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-74207513-d277-4158-a20f-2967fc4eb45f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:31.042964 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-74207513-d277-4158-a20f-2967fc4eb45f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:31.043440 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-74207513-d277-4158-a20f-2967fc4eb45f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:31.134118 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-74207513-d277-4158-a20f-2967fc4eb45f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.104648 Jan 17 21:30:31.134817 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 547/1091] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:31 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:30:32.148720 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2acfd3ff-e9cf-4a31-bb4f-f784b8fe382c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:32.149848 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2acfd3ff-e9cf-4a31-bb4f-f784b8fe382c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:32.157408 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2acfd3ff-e9cf-4a31-bb4f-f784b8fe382c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:32.157860 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2acfd3ff-e9cf-4a31-bb4f-f784b8fe382c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:32.158674 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2acfd3ff-e9cf-4a31-bb4f-f784b8fe382c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:32.159112 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2acfd3ff-e9cf-4a31-bb4f-f784b8fe382c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:32.223678 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2acfd3ff-e9cf-4a31-bb4f-f784b8fe382c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.079098 Jan 17 21:30:32.224894 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 545/1092] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:32 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:30:33.236735 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-589e5e5c-1db9-48bb-adeb-f1907ce21216 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:33.237643 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-589e5e5c-1db9-48bb-adeb-f1907ce21216 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:33.245425 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-589e5e5c-1db9-48bb-adeb-f1907ce21216 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:33.245887 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-589e5e5c-1db9-48bb-adeb-f1907ce21216 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:33.246703 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-589e5e5c-1db9-48bb-adeb-f1907ce21216 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:33.247155 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-589e5e5c-1db9-48bb-adeb-f1907ce21216 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:33.310561 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-589e5e5c-1db9-48bb-adeb-f1907ce21216 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.078558 Jan 17 21:30:33.311327 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 548/1093] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:33 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:30:34.323620 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-28f49956-7ae0-4c74-8aa6-33190d66e595 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:34.324587 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-28f49956-7ae0-4c74-8aa6-33190d66e595 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:34.332065 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-28f49956-7ae0-4c74-8aa6-33190d66e595 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:34.332561 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-28f49956-7ae0-4c74-8aa6-33190d66e595 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:34.333378 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-28f49956-7ae0-4c74-8aa6-33190d66e595 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:34.333824 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-28f49956-7ae0-4c74-8aa6-33190d66e595 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:34.402407 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-28f49956-7ae0-4c74-8aa6-33190d66e595 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.082787 Jan 17 21:30:34.403207 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 546/1094] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:34 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:35.414638 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-19f74f47-2512-465a-8e10-fc087c6492c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:35.415651 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-19f74f47-2512-465a-8e10-fc087c6492c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:35.422782 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-19f74f47-2512-465a-8e10-fc087c6492c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:35.423236 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-19f74f47-2512-465a-8e10-fc087c6492c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:35.424036 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-19f74f47-2512-465a-8e10-fc087c6492c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:35.424506 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-19f74f47-2512-465a-8e10-fc087c6492c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:35.493852 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-19f74f47-2512-465a-8e10-fc087c6492c9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.083446 Jan 17 21:30:35.494780 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 549/1095] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:35 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:36.507137 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-27e3c01a-590b-4213-86c2-cc1185e652fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:36.509806 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-27e3c01a-590b-4213-86c2-cc1185e652fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:36.518586 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-27e3c01a-590b-4213-86c2-cc1185e652fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:36.519444 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-27e3c01a-590b-4213-86c2-cc1185e652fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:36.520274 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-27e3c01a-590b-4213-86c2-cc1185e652fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:36.520755 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-27e3c01a-590b-4213-86c2-cc1185e652fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:36.585357 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-27e3c01a-590b-4213-86c2-cc1185e652fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.082654 Jan 17 21:30:36.586019 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 547/1096] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:36 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:37.598831 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f27afe1c-f4bc-40d9-a2b2-8e7d14ce1a28 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:37.599896 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f27afe1c-f4bc-40d9-a2b2-8e7d14ce1a28 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:37.607615 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f27afe1c-f4bc-40d9-a2b2-8e7d14ce1a28 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:37.608132 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f27afe1c-f4bc-40d9-a2b2-8e7d14ce1a28 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:37.609073 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f27afe1c-f4bc-40d9-a2b2-8e7d14ce1a28 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:37.609645 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f27afe1c-f4bc-40d9-a2b2-8e7d14ce1a28 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:37.684673 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f27afe1c-f4bc-40d9-a2b2-8e7d14ce1a28 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.090510 Jan 17 21:30:37.685334 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 550/1097] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:37 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:30:38.696899 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c39e3ed1-9fb8-4a4c-958f-d416b5b6c73e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:38.697812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c39e3ed1-9fb8-4a4c-958f-d416b5b6c73e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:38.704949 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c39e3ed1-9fb8-4a4c-958f-d416b5b6c73e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:38.705409 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c39e3ed1-9fb8-4a4c-958f-d416b5b6c73e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:38.706499 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c39e3ed1-9fb8-4a4c-958f-d416b5b6c73e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:38.706946 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c39e3ed1-9fb8-4a4c-958f-d416b5b6c73e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:38.775583 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c39e3ed1-9fb8-4a4c-958f-d416b5b6c73e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.082810 Jan 17 21:30:38.776292 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 548/1098] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:38 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:30:39.787826 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b9e198ee-47d9-4b6d-a783-f163aa0843f9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:39.788859 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b9e198ee-47d9-4b6d-a783-f163aa0843f9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:39.795818 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b9e198ee-47d9-4b6d-a783-f163aa0843f9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:39.796283 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b9e198ee-47d9-4b6d-a783-f163aa0843f9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:39.797111 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b9e198ee-47d9-4b6d-a783-f163aa0843f9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:39.797557 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b9e198ee-47d9-4b6d-a783-f163aa0843f9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:39.866830 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b9e198ee-47d9-4b6d-a783-f163aa0843f9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.082963 Jan 17 21:30:39.867514 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 551/1099] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:39 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:40.880109 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-570182bc-cd9c-4dd8-b319-4d49fad89dd6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:40.881123 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-570182bc-cd9c-4dd8-b319-4d49fad89dd6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:40.888498 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-570182bc-cd9c-4dd8-b319-4d49fad89dd6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:40.888963 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-570182bc-cd9c-4dd8-b319-4d49fad89dd6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:40.889782 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-570182bc-cd9c-4dd8-b319-4d49fad89dd6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:40.890224 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-570182bc-cd9c-4dd8-b319-4d49fad89dd6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:40.966049 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-570182bc-cd9c-4dd8-b319-4d49fad89dd6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.090081 Jan 17 21:30:40.968439 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 549/1100] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:40 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:41.979809 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-74dcb311-4cc8-4df0-905a-243ea5f4a3b3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:41.980859 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-74dcb311-4cc8-4df0-905a-243ea5f4a3b3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:41.988451 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-74dcb311-4cc8-4df0-905a-243ea5f4a3b3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:41.988882 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-74dcb311-4cc8-4df0-905a-243ea5f4a3b3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:41.989685 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-74dcb311-4cc8-4df0-905a-243ea5f4a3b3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:41.990132 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-74dcb311-4cc8-4df0-905a-243ea5f4a3b3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:42.059692 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-74dcb311-4cc8-4df0-905a-243ea5f4a3b3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.083375 Jan 17 21:30:42.060764 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 552/1101] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:41 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:43.072541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8d3e2789-9f6a-44d0-bddd-01acd6d3f3dc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:43.074011 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8d3e2789-9f6a-44d0-bddd-01acd6d3f3dc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:43.084724 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8d3e2789-9f6a-44d0-bddd-01acd6d3f3dc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:43.085587 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8d3e2789-9f6a-44d0-bddd-01acd6d3f3dc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:43.087320 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8d3e2789-9f6a-44d0-bddd-01acd6d3f3dc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:43.088426 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8d3e2789-9f6a-44d0-bddd-01acd6d3f3dc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:43.169996 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8d3e2789-9f6a-44d0-bddd-01acd6d3f3dc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.101355 Jan 17 21:30:43.170658 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 550/1102] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:43 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:44.182097 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-cdb27ec4-d5b4-4abb-8fa3-92ee0673302b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:44.183144 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-cdb27ec4-d5b4-4abb-8fa3-92ee0673302b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:44.190984 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cdb27ec4-d5b4-4abb-8fa3-92ee0673302b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:44.191409 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cdb27ec4-d5b4-4abb-8fa3-92ee0673302b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:44.192209 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cdb27ec4-d5b4-4abb-8fa3-92ee0673302b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:44.192674 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cdb27ec4-d5b4-4abb-8fa3-92ee0673302b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:44.257700 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-cdb27ec4-d5b4-4abb-8fa3-92ee0673302b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.079461 Jan 17 21:30:44.258287 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 553/1103] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:44 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:45.270763 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-eac14726-59c4-4214-b518-652284c7c4b6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:45.271690 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-eac14726-59c4-4214-b518-652284c7c4b6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:45.282143 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eac14726-59c4-4214-b518-652284c7c4b6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:45.282587 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eac14726-59c4-4214-b518-652284c7c4b6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:45.283402 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eac14726-59c4-4214-b518-652284c7c4b6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:45.283843 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eac14726-59c4-4214-b518-652284c7c4b6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:45.349405 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-eac14726-59c4-4214-b518-652284c7c4b6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.083161 Jan 17 21:30:45.350237 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 551/1104] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:45 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:46.361930 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a36b96bc-9d4f-465e-bfd4-8864eacb0cc1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:46.362942 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a36b96bc-9d4f-465e-bfd4-8864eacb0cc1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:46.370060 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a36b96bc-9d4f-465e-bfd4-8864eacb0cc1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:46.370516 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a36b96bc-9d4f-465e-bfd4-8864eacb0cc1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:46.371319 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a36b96bc-9d4f-465e-bfd4-8864eacb0cc1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:46.371767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a36b96bc-9d4f-465e-bfd4-8864eacb0cc1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:46.435409 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a36b96bc-9d4f-465e-bfd4-8864eacb0cc1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.077478 Jan 17 21:30:46.436077 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 554/1105] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:46 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:47.447778 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e61aa553-47e8-45ae-b768-0d984bc5a727 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:47.448817 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-e61aa553-47e8-45ae-b768-0d984bc5a727 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:47.455732 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e61aa553-47e8-45ae-b768-0d984bc5a727 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:47.456735 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e61aa553-47e8-45ae-b768-0d984bc5a727 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:47.457536 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e61aa553-47e8-45ae-b768-0d984bc5a727 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:47.457978 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e61aa553-47e8-45ae-b768-0d984bc5a727 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:47.519497 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e61aa553-47e8-45ae-b768-0d984bc5a727 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.075119 Jan 17 21:30:47.520151 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 552/1106] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:47 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:48.532642 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-372ff3db-f6b2-41cf-87ce-6aead0734de9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:48.533755 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-372ff3db-f6b2-41cf-87ce-6aead0734de9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:48.541565 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-372ff3db-f6b2-41cf-87ce-6aead0734de9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:48.542019 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-372ff3db-f6b2-41cf-87ce-6aead0734de9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:48.542819 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-372ff3db-f6b2-41cf-87ce-6aead0734de9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:48.543255 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-372ff3db-f6b2-41cf-87ce-6aead0734de9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:48.608523 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-372ff3db-f6b2-41cf-87ce-6aead0734de9 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.079948 Jan 17 21:30:48.613692 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 555/1107] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:48 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:30:49.047370 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-57a9fe76-3ef2-4558-a061-fc0a4ccaf46e tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:49.049527 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-57a9fe76-3ef2-4558-a061-fc0a4ccaf46e tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:49.050915 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-be691e02-a182-41a9-9ede-09b8baa0ff7c req-325b003e-854e-4218-b9f6-ea7bbcc490b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a05a7cb-fb38-46fe-a04b-f8c66845fbd8", "tag": "858678d3-306c-4afa-9059-494f90b38571"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:49.053430 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:30:49.053430 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:30:49.061340 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-57a9fe76-3ef2-4558-a061-fc0a4ccaf46e tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:49.062127 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-57a9fe76-3ef2-4558-a061-fc0a4ccaf46e tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:49.063527 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-57a9fe76-3ef2-4558-a061-fc0a4ccaf46e tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:49.064282 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-57a9fe76-3ef2-4558-a061-fc0a4ccaf46e tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:49.065093 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-be691e02-a182-41a9-9ede-09b8baa0ff7c req-325b003e-854e-4218-b9f6-ea7bbcc490b4 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:49.065859 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-be691e02-a182-41a9-9ede-09b8baa0ff7c req-325b003e-854e-4218-b9f6-ea7bbcc490b4 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:49.086435 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-be691e02-a182-41a9-9ede-09b8baa0ff7c req-325b003e-854e-4218-b9f6-ea7bbcc490b4 service nova] Creating event network-changed:858678d3-306c-4afa-9059-494f90b38571 for instance 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 on hv-cinder-82489 Jan 17 21:30:49.093802 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-be691e02-a182-41a9-9ede-09b8baa0ff7c req-325b003e-854e-4218-b9f6-ea7bbcc490b4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046774 Jan 17 21:30:49.095026 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 556/1108] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:30:49.112861 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-57a9fe76-3ef2-4558-a061-fc0a4ccaf46e tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Going to try to terminate instance {{(pid=116183) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:30:49.247517 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-57a9fe76-3ef2-4558-a061-fc0a4ccaf46e tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 204 len: 0 microversion: 2.1 time: 0.205099 Jan 17 21:30:49.248171 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 553/1109] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:30:49 2022] DELETE /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:30:49.259038 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-22cc6ab2-bfdb-4d3d-a565-3e7ef18ec8b7 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:49.259781 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-22cc6ab2-bfdb-4d3d-a565-3e7ef18ec8b7 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:49.267036 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-22cc6ab2-bfdb-4d3d-a565-3e7ef18ec8b7 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:49.267499 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-22cc6ab2-bfdb-4d3d-a565-3e7ef18ec8b7 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:49.268430 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-22cc6ab2-bfdb-4d3d-a565-3e7ef18ec8b7 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:49.268871 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-22cc6ab2-bfdb-4d3d-a565-3e7ef18ec8b7 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:49.482025 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-22cc6ab2-bfdb-4d3d-a565-3e7ef18ec8b7 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:30:49.498083 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-22cc6ab2-bfdb-4d3d-a565-3e7ef18ec8b7 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1569 microversion: 2.1 time: 0.242655 Jan 17 21:30:49.499423 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 557/1110] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:30:49 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:30:49.623512 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2ed672b2-3732-4f12-9a83-16fe92ae3217 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:49.625266 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2ed672b2-3732-4f12-9a83-16fe92ae3217 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:49.633745 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2ed672b2-3732-4f12-9a83-16fe92ae3217 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:49.634378 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2ed672b2-3732-4f12-9a83-16fe92ae3217 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:49.635485 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2ed672b2-3732-4f12-9a83-16fe92ae3217 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:49.636105 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2ed672b2-3732-4f12-9a83-16fe92ae3217 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:49.720757 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2ed672b2-3732-4f12-9a83-16fe92ae3217 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.101882 Jan 17 21:30:49.722469 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 554/1111] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:49 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:50.523918 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f422e9c3-8deb-4db9-b14d-8e7e429ac082 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:50.524581 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f422e9c3-8deb-4db9-b14d-8e7e429ac082 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:50.531105 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f422e9c3-8deb-4db9-b14d-8e7e429ac082 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:50.531560 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f422e9c3-8deb-4db9-b14d-8e7e429ac082 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:50.532362 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f422e9c3-8deb-4db9-b14d-8e7e429ac082 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:50.532830 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f422e9c3-8deb-4db9-b14d-8e7e429ac082 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:50.677335 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f422e9c3-8deb-4db9-b14d-8e7e429ac082 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:30:50.685213 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f422e9c3-8deb-4db9-b14d-8e7e429ac082 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1450 microversion: 2.1 time: 0.164960 Jan 17 21:30:50.685794 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 558/1112] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:30:50 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:30:50.735641 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8e336303-3080-432a-b84b-92b15a7f1638 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:50.738217 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8e336303-3080-432a-b84b-92b15a7f1638 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:50.744784 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8e336303-3080-432a-b84b-92b15a7f1638 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:50.745257 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8e336303-3080-432a-b84b-92b15a7f1638 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:50.746078 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8e336303-3080-432a-b84b-92b15a7f1638 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:50.746529 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8e336303-3080-432a-b84b-92b15a7f1638 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:50.813961 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8e336303-3080-432a-b84b-92b15a7f1638 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.082157 Jan 17 21:30:50.814609 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 555/1113] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:50 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:51.615002 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-8933ac9f-b0c5-4581-8ba7-e652b42baa84 req-b6a90fec-bb00-45ce-9790-be3708d5786f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a05a7cb-fb38-46fe-a04b-f8c66845fbd8", "name": "network-vif-deleted", "tag": "858678d3-306c-4afa-9059-494f90b38571"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:51.616665 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:30:51.616665 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:30:51.624101 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-8933ac9f-b0c5-4581-8ba7-e652b42baa84 req-b6a90fec-bb00-45ce-9790-be3708d5786f service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:51.624596 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-8933ac9f-b0c5-4581-8ba7-e652b42baa84 req-b6a90fec-bb00-45ce-9790-be3708d5786f service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:51.638053 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-8933ac9f-b0c5-4581-8ba7-e652b42baa84 req-b6a90fec-bb00-45ce-9790-be3708d5786f service nova] Creating event network-vif-deleted:858678d3-306c-4afa-9059-494f90b38571 for instance 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 on hv-cinder-82489 Jan 17 21:30:51.644197 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-8933ac9f-b0c5-4581-8ba7-e652b42baa84 req-b6a90fec-bb00-45ce-9790-be3708d5786f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193903 Jan 17 21:30:51.647907 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 559/1114] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:30:51.708129 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-df2299ce-4675-4f46-856f-bf9685917738 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:51.709040 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-df2299ce-4675-4f46-856f-bf9685917738 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:51.718402 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-df2299ce-4675-4f46-856f-bf9685917738 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:51.718860 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-df2299ce-4675-4f46-856f-bf9685917738 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:51.719639 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-df2299ce-4675-4f46-856f-bf9685917738 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:51.720085 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-df2299ce-4675-4f46-856f-bf9685917738 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:51.822485 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-df2299ce-4675-4f46-856f-bf9685917738 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '335e9c01fa8345f4bf1e14cce86abb2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ec979393344e694cfdd0eab44cb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:30:51.829829 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0fa342ff-1b6b-452c-ba9e-7a93d9a4aedd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:51.832359 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0fa342ff-1b6b-452c-ba9e-7a93d9a4aedd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:51.833592 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-df2299ce-4675-4f46-856f-bf9685917738 tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 200 len: 1219 microversion: 2.1 time: 0.131834 Jan 17 21:30:51.834952 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 556/1115] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:30:51 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 1219 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:30:51.854023 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0fa342ff-1b6b-452c-ba9e-7a93d9a4aedd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:51.854830 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0fa342ff-1b6b-452c-ba9e-7a93d9a4aedd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:51.856239 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0fa342ff-1b6b-452c-ba9e-7a93d9a4aedd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:51.857005 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0fa342ff-1b6b-452c-ba9e-7a93d9a4aedd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:51.952437 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0fa342ff-1b6b-452c-ba9e-7a93d9a4aedd tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.129337 Jan 17 21:30:51.957851 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 560/1116] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:51 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:52.851509 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-42f04fe3-e966-4c6d-8467-bf962ac196fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:52.852155 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-42f04fe3-e966-4c6d-8467-bf962ac196fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] [instance: 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:52.859563 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-42f04fe3-e966-4c6d-8467-bf962ac196fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:52.860171 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-42f04fe3-e966-4c6d-8467-bf962ac196fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:52.861163 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-42f04fe3-e966-4c6d-8467-bf962ac196fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:52.861636 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-42f04fe3-e966-4c6d-8467-bf962ac196fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:52.877294 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-42f04fe3-e966-4c6d-8467-bf962ac196fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] HTTP exception thrown: Instance 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 could not be found. Jan 17 21:30:52.878479 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-42f04fe3-e966-4c6d-8467-bf962ac196fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Returning 404 to user: Instance 7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:30:52.879324 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-42f04fe3-e966-4c6d-8467-bf962ac196fe tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8" status: 404 len: 111 microversion: 2.1 time: 0.031744 Jan 17 21:30:52.879894 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 557/1117] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:30:52 2022] GET /compute/v2.1/servers/7a05a7cb-fb38-46fe-a04b-f8c66845fbd8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:30:52.970535 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5904c523-45c1-4444-856a-d415f1ae4663 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:52.973799 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5904c523-45c1-4444-856a-d415f1ae4663 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:52.986217 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5904c523-45c1-4444-856a-d415f1ae4663 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:52.987256 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5904c523-45c1-4444-856a-d415f1ae4663 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:52.991174 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5904c523-45c1-4444-856a-d415f1ae4663 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:52.992034 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5904c523-45c1-4444-856a-d415f1ae4663 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:53.087290 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5904c523-45c1-4444-856a-d415f1ae4663 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.121653 Jan 17 21:30:53.090896 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 561/1118] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:52 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:53.097473 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ee529244-2952-421f-9148-5b2f98c6fc5d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] Calling method '.version_select at 0x7f8976a211f0>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:30:53.139579 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ee529244-2952-421f-9148-5b2f98c6fc5d tempest-TestShelveInstance-1696670208 tempest-TestShelveInstance-1696670208-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1095543640" status: 202 len: 0 microversion: 2.1 time: 0.050643 Jan 17 21:30:53.147757 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 558/1119] 10.222.0.64 () {58 vars in 1253 bytes} [Mon Jan 17 21:30:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1095543640 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:54.100864 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-91a33dcc-9997-44ae-8a38-3c9a57b586cc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:54.102309 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-91a33dcc-9997-44ae-8a38-3c9a57b586cc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:54.114647 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-91a33dcc-9997-44ae-8a38-3c9a57b586cc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:54.115425 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-91a33dcc-9997-44ae-8a38-3c9a57b586cc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:54.116964 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-91a33dcc-9997-44ae-8a38-3c9a57b586cc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:54.117749 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-91a33dcc-9997-44ae-8a38-3c9a57b586cc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:54.206743 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-91a33dcc-9997-44ae-8a38-3c9a57b586cc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.110886 Jan 17 21:30:54.208109 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 562/1120] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:54 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:55.219832 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-72ff9dbe-7f13-4a2e-8c18-6fdbb94ab812 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:55.220736 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-72ff9dbe-7f13-4a2e-8c18-6fdbb94ab812 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:55.233872 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-72ff9dbe-7f13-4a2e-8c18-6fdbb94ab812 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:55.234352 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-72ff9dbe-7f13-4a2e-8c18-6fdbb94ab812 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:55.235189 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-72ff9dbe-7f13-4a2e-8c18-6fdbb94ab812 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:55.235644 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-72ff9dbe-7f13-4a2e-8c18-6fdbb94ab812 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:55.315756 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-72ff9dbe-7f13-4a2e-8c18-6fdbb94ab812 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.099211 Jan 17 21:30:55.318118 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 559/1121] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:55 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:56.334956 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2ec9112b-2c72-498b-9629-bc4e2cf047d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:56.337745 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2ec9112b-2c72-498b-9629-bc4e2cf047d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:56.348828 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2ec9112b-2c72-498b-9629-bc4e2cf047d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:56.349146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2ec9112b-2c72-498b-9629-bc4e2cf047d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:56.349937 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2ec9112b-2c72-498b-9629-bc4e2cf047d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:56.350399 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2ec9112b-2c72-498b-9629-bc4e2cf047d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:56.440260 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2ec9112b-2c72-498b-9629-bc4e2cf047d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 28694 microversion: 2.20 time: 0.113619 Jan 17 21:30:56.445681 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 563/1122] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:56 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 28694 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:57.461425 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d9fab6ff-1a38-428b-a203-62fdb0e6af98 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:57.465943 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d9fab6ff-1a38-428b-a203-62fdb0e6af98 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:57.480181 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d9fab6ff-1a38-428b-a203-62fdb0e6af98 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:57.481618 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d9fab6ff-1a38-428b-a203-62fdb0e6af98 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:57.483539 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d9fab6ff-1a38-428b-a203-62fdb0e6af98 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:57.484776 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d9fab6ff-1a38-428b-a203-62fdb0e6af98 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:57.587992 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d9fab6ff-1a38-428b-a203-62fdb0e6af98 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 30225 microversion: 2.20 time: 0.136686 Jan 17 21:30:57.593033 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 560/1123] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:57 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 30225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:30:58.601822 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3214ffa6-9f26-4432-ab02-00f822d4c097 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:58.603648 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-3214ffa6-9f26-4432-ab02-00f822d4c097 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:58.614969 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3214ffa6-9f26-4432-ab02-00f822d4c097 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:58.616912 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3214ffa6-9f26-4432-ab02-00f822d4c097 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:58.618177 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3214ffa6-9f26-4432-ab02-00f822d4c097 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:58.619926 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3214ffa6-9f26-4432-ab02-00f822d4c097 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:58.700544 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3214ffa6-9f26-4432-ab02-00f822d4c097 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 32251 microversion: 2.20 time: 0.101005 Jan 17 21:30:58.701489 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 564/1124] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:58 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 32251 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:30:59.713928 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9819116c-aa4f-45eb-aa1f-4e4fb7548948 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:30:59.715594 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-9819116c-aa4f-45eb-aa1f-4e4fb7548948 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:30:59.723389 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9819116c-aa4f-45eb-aa1f-4e4fb7548948 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:59.724101 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9819116c-aa4f-45eb-aa1f-4e4fb7548948 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:59.725004 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9819116c-aa4f-45eb-aa1f-4e4fb7548948 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:30:59.725709 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9819116c-aa4f-45eb-aa1f-4e4fb7548948 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:30:59.800622 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-9819116c-aa4f-45eb-aa1f-4e4fb7548948 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 33554 microversion: 2.20 time: 0.090946 Jan 17 21:30:59.801705 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 561/1125] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:30:59 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 33554 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:31:00.813421 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4b3d5a12-0f0e-4bc1-9d35-55d980a7530d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:00.816474 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4b3d5a12-0f0e-4bc1-9d35-55d980a7530d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:00.829378 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4b3d5a12-0f0e-4bc1-9d35-55d980a7530d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:00.830584 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4b3d5a12-0f0e-4bc1-9d35-55d980a7530d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:00.832576 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4b3d5a12-0f0e-4bc1-9d35-55d980a7530d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:00.833604 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4b3d5a12-0f0e-4bc1-9d35-55d980a7530d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:00.933055 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4b3d5a12-0f0e-4bc1-9d35-55d980a7530d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 34618 microversion: 2.20 time: 0.124357 Jan 17 21:31:00.934084 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 565/1126] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:31:00 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 34618 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:31:01.947030 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-175b9535-86d6-4ba1-bfb4-cd763c3065bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:01.947990 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-175b9535-86d6-4ba1-bfb4-cd763c3065bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:01.956170 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-175b9535-86d6-4ba1-bfb4-cd763c3065bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:01.956656 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-175b9535-86d6-4ba1-bfb4-cd763c3065bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:01.957468 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-175b9535-86d6-4ba1-bfb4-cd763c3065bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:01.957914 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-175b9535-86d6-4ba1-bfb4-cd763c3065bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:02.039674 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-175b9535-86d6-4ba1-bfb4-cd763c3065bc tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 35786 microversion: 2.20 time: 0.096792 Jan 17 21:31:02.040346 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 562/1127] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:31:01 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 35786 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:31:03.052898 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7a4163d1-be0e-45a5-b5fa-f1e55aee51d5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:03.053901 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7a4163d1-be0e-45a5-b5fa-f1e55aee51d5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:03.061134 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7a4163d1-be0e-45a5-b5fa-f1e55aee51d5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:03.061583 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7a4163d1-be0e-45a5-b5fa-f1e55aee51d5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:03.062379 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7a4163d1-be0e-45a5-b5fa-f1e55aee51d5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:03.062814 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7a4163d1-be0e-45a5-b5fa-f1e55aee51d5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:03.137684 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7a4163d1-be0e-45a5-b5fa-f1e55aee51d5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 37463 microversion: 2.20 time: 0.089216 Jan 17 21:31:03.138380 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 566/1128] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:31:03 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 37463 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:31:04.153256 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-047354c6-1af2-407c-9fac-e059f593cf73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:04.154252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-047354c6-1af2-407c-9fac-e059f593cf73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:04.161224 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-047354c6-1af2-407c-9fac-e059f593cf73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:04.161673 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-047354c6-1af2-407c-9fac-e059f593cf73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:04.162455 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-047354c6-1af2-407c-9fac-e059f593cf73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:04.162919 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-047354c6-1af2-407c-9fac-e059f593cf73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:04.239352 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-047354c6-1af2-407c-9fac-e059f593cf73 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 38249 microversion: 2.20 time: 0.089987 Jan 17 21:31:04.239922 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 563/1129] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:31:04 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 38249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:31:05.251891 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5a26c014-4178-45b6-9e1f-db6c4f896bdf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:05.252873 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5a26c014-4178-45b6-9e1f-db6c4f896bdf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:05.259906 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a26c014-4178-45b6-9e1f-db6c4f896bdf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:05.260378 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a26c014-4178-45b6-9e1f-db6c4f896bdf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:05.261193 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a26c014-4178-45b6-9e1f-db6c4f896bdf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:05.261638 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5a26c014-4178-45b6-9e1f-db6c4f896bdf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:05.325749 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5a26c014-4178-45b6-9e1f-db6c4f896bdf tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 38249 microversion: 2.20 time: 0.077820 Jan 17 21:31:05.326433 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 567/1130] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:31:05 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 38249 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:31:06.339890 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-06690112-5da2-4b47-a3f5-4afed986e106 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:06.340832 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-06690112-5da2-4b47-a3f5-4afed986e106 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:06.348590 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-06690112-5da2-4b47-a3f5-4afed986e106 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:06.349053 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-06690112-5da2-4b47-a3f5-4afed986e106 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:06.349867 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-06690112-5da2-4b47-a3f5-4afed986e106 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:06.350316 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-06690112-5da2-4b47-a3f5-4afed986e106 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:06.414438 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-06690112-5da2-4b47-a3f5-4afed986e106 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 38249 microversion: 2.20 time: 0.078207 Jan 17 21:31:06.415440 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 564/1131] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:31:06 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 38249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:31:07.428675 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1c255283-4cca-40b3-a05f-5071ea19660f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:07.429702 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1c255283-4cca-40b3-a05f-5071ea19660f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:07.436593 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c255283-4cca-40b3-a05f-5071ea19660f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:07.437044 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c255283-4cca-40b3-a05f-5071ea19660f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:07.437832 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c255283-4cca-40b3-a05f-5071ea19660f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:07.438267 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1c255283-4cca-40b3-a05f-5071ea19660f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:07.499971 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1c255283-4cca-40b3-a05f-5071ea19660f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 38249 microversion: 2.20 time: 0.076163 Jan 17 21:31:07.500667 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 568/1132] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:31:07 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 38249 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:31:08.513513 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-64011c6b-81f2-41be-ad57-8443c3eed679 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:08.514510 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-64011c6b-81f2-41be-ad57-8443c3eed679 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:08.521521 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-64011c6b-81f2-41be-ad57-8443c3eed679 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:08.521983 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-64011c6b-81f2-41be-ad57-8443c3eed679 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:08.522774 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-64011c6b-81f2-41be-ad57-8443c3eed679 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:08.523218 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-64011c6b-81f2-41be-ad57-8443c3eed679 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:08.601355 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-64011c6b-81f2-41be-ad57-8443c3eed679 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 200 len: 38390 microversion: 2.20 time: 0.091903 Jan 17 21:31:08.602137 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 565/1133] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:31:08 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 38390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:31:08.613413 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fede0f27-a5cf-4c32-b403-e61b8fc38d0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:08.613994 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fede0f27-a5cf-4c32-b403-e61b8fc38d0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:08.620891 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fede0f27-a5cf-4c32-b403-e61b8fc38d0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:08.621347 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fede0f27-a5cf-4c32-b403-e61b8fc38d0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:08.622138 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fede0f27-a5cf-4c32-b403-e61b8fc38d0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:08.622580 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fede0f27-a5cf-4c32-b403-e61b8fc38d0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:08.645700 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fede0f27-a5cf-4c32-b403-e61b8fc38d0d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/ips" status: 200 len: 152 microversion: 2.20 time: 0.037323 Jan 17 21:31:08.646268 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 569/1134] 10.222.0.64 () {60 vars in 1288 bytes} [Mon Jan 17 21:31:08 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:31:10.800992 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2a9344d5-3ca3-463e-b3ef-0f870a91fc5d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:10.801650 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2a9344d5-3ca3-463e-b3ef-0f870a91fc5d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:10.808717 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a9344d5-3ca3-463e-b3ef-0f870a91fc5d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:10.809178 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a9344d5-3ca3-463e-b3ef-0f870a91fc5d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:10.809970 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a9344d5-3ca3-463e-b3ef-0f870a91fc5d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:10.810416 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2a9344d5-3ca3-463e-b3ef-0f870a91fc5d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:10.848498 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.objects.instance [None req-2a9344d5-3ca3-463e-b3ef-0f870a91fc5d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lazy-loading 'flavor' on Instance uuid 0bc3ee12-556d-4522-9fae-d6c208109ee4 {{(pid=116183) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:31:11.102805 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2a9344d5-3ca3-463e-b3ef-0f870a91fc5d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 202 len: 0 microversion: 2.20 time: 0.305844 Jan 17 21:31:11.103572 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 566/1135] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:31:10 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:31:11.112061 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6e3a8da6-e627-4165-a873-368afac82286 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:11.112986 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6e3a8da6-e627-4165-a873-368afac82286 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:11.120935 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6e3a8da6-e627-4165-a873-368afac82286 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:11.121516 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6e3a8da6-e627-4165-a873-368afac82286 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:11.122265 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6e3a8da6-e627-4165-a873-368afac82286 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:11.122769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6e3a8da6-e627-4165-a873-368afac82286 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:11.268416 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6e3a8da6-e627-4165-a873-368afac82286 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:11.276164 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6e3a8da6-e627-4165-a873-368afac82286 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:11.277702 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6e3a8da6-e627-4165-a873-368afac82286 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:11.278863 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6e3a8da6-e627-4165-a873-368afac82286 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.171089 Jan 17 21:31:11.279421 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 570/1136] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:11 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:12.298095 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b12c1633-a4e3-4e3b-b230-102ffd909790 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:12.299318 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b12c1633-a4e3-4e3b-b230-102ffd909790 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:12.305562 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b12c1633-a4e3-4e3b-b230-102ffd909790 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:12.306018 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b12c1633-a4e3-4e3b-b230-102ffd909790 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:12.306802 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b12c1633-a4e3-4e3b-b230-102ffd909790 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:12.307244 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b12c1633-a4e3-4e3b-b230-102ffd909790 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:12.438397 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b12c1633-a4e3-4e3b-b230-102ffd909790 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:12.446221 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b12c1633-a4e3-4e3b-b230-102ffd909790 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:12.447723 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b12c1633-a4e3-4e3b-b230-102ffd909790 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:12.448906 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b12c1633-a4e3-4e3b-b230-102ffd909790 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.155344 Jan 17 21:31:12.449466 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 567/1137] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:12 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:13.466952 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-96143018-424c-4b8d-86ae-bc6485a09802 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:13.467585 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-96143018-424c-4b8d-86ae-bc6485a09802 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:13.474905 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-96143018-424c-4b8d-86ae-bc6485a09802 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:13.475392 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-96143018-424c-4b8d-86ae-bc6485a09802 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:13.476216 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-96143018-424c-4b8d-86ae-bc6485a09802 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:13.476648 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-96143018-424c-4b8d-86ae-bc6485a09802 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:13.609527 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-96143018-424c-4b8d-86ae-bc6485a09802 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:13.617425 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-96143018-424c-4b8d-86ae-bc6485a09802 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:13.618966 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-96143018-424c-4b8d-86ae-bc6485a09802 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:13.620102 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-96143018-424c-4b8d-86ae-bc6485a09802 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.156932 Jan 17 21:31:13.620703 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 571/1138] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:13 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:14.638185 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6458046e-b482-476a-92b2-abbbe03a04fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:14.638798 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6458046e-b482-476a-92b2-abbbe03a04fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:14.645942 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6458046e-b482-476a-92b2-abbbe03a04fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:14.646416 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6458046e-b482-476a-92b2-abbbe03a04fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:14.647201 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6458046e-b482-476a-92b2-abbbe03a04fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:14.647633 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6458046e-b482-476a-92b2-abbbe03a04fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:14.780715 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6458046e-b482-476a-92b2-abbbe03a04fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:14.788595 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6458046e-b482-476a-92b2-abbbe03a04fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:14.790097 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6458046e-b482-476a-92b2-abbbe03a04fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:14.791254 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6458046e-b482-476a-92b2-abbbe03a04fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.156759 Jan 17 21:31:14.791825 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 568/1139] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:14 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:15.809301 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4b176b7c-6cf0-4f2e-8348-78291c971cd2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:15.809908 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4b176b7c-6cf0-4f2e-8348-78291c971cd2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:15.816239 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4b176b7c-6cf0-4f2e-8348-78291c971cd2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:15.816731 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4b176b7c-6cf0-4f2e-8348-78291c971cd2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:15.817516 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4b176b7c-6cf0-4f2e-8348-78291c971cd2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:15.817961 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4b176b7c-6cf0-4f2e-8348-78291c971cd2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:15.948152 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4b176b7c-6cf0-4f2e-8348-78291c971cd2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:15.956883 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4b176b7c-6cf0-4f2e-8348-78291c971cd2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:15.958382 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4b176b7c-6cf0-4f2e-8348-78291c971cd2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:15.959561 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4b176b7c-6cf0-4f2e-8348-78291c971cd2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.154019 Jan 17 21:31:15.960475 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 572/1140] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:15 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:31:16.979016 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-982d8e88-42f2-4876-9ca5-f0301d403e1a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:16.979642 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-982d8e88-42f2-4876-9ca5-f0301d403e1a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:16.986570 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-982d8e88-42f2-4876-9ca5-f0301d403e1a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:16.987025 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-982d8e88-42f2-4876-9ca5-f0301d403e1a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:16.987816 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-982d8e88-42f2-4876-9ca5-f0301d403e1a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:16.988252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-982d8e88-42f2-4876-9ca5-f0301d403e1a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:17.124801 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-982d8e88-42f2-4876-9ca5-f0301d403e1a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:17.133713 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-982d8e88-42f2-4876-9ca5-f0301d403e1a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:17.135366 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-982d8e88-42f2-4876-9ca5-f0301d403e1a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:17.136618 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-982d8e88-42f2-4876-9ca5-f0301d403e1a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.161283 Jan 17 21:31:17.137170 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 569/1141] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:16 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:18.155435 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6be9e05f-3fa2-48d5-a915-586eea06f9eb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:18.156049 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6be9e05f-3fa2-48d5-a915-586eea06f9eb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:18.163234 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6be9e05f-3fa2-48d5-a915-586eea06f9eb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:18.163688 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6be9e05f-3fa2-48d5-a915-586eea06f9eb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:18.164513 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6be9e05f-3fa2-48d5-a915-586eea06f9eb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:18.164965 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6be9e05f-3fa2-48d5-a915-586eea06f9eb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:18.304940 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6be9e05f-3fa2-48d5-a915-586eea06f9eb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:18.313470 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6be9e05f-3fa2-48d5-a915-586eea06f9eb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:18.315433 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-6be9e05f-3fa2-48d5-a915-586eea06f9eb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:18.316713 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6be9e05f-3fa2-48d5-a915-586eea06f9eb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.165016 Jan 17 21:31:18.317283 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 573/1142] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:18 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:19.334813 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2320c143-6ad4-4f34-821a-1aadd614033e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:19.335664 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2320c143-6ad4-4f34-821a-1aadd614033e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:19.342123 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2320c143-6ad4-4f34-821a-1aadd614033e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:19.342596 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2320c143-6ad4-4f34-821a-1aadd614033e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:19.343402 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2320c143-6ad4-4f34-821a-1aadd614033e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:19.343850 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2320c143-6ad4-4f34-821a-1aadd614033e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:19.530640 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2320c143-6ad4-4f34-821a-1aadd614033e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:19.544164 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2320c143-6ad4-4f34-821a-1aadd614033e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:19.547306 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2320c143-6ad4-4f34-821a-1aadd614033e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:19.549870 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2320c143-6ad4-4f34-821a-1aadd614033e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.218586 Jan 17 21:31:19.551178 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 570/1143] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:19 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:20.572350 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a9113d05-5c76-4f66-aa87-ad5f5553acc6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:20.573143 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a9113d05-5c76-4f66-aa87-ad5f5553acc6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:20.579810 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a9113d05-5c76-4f66-aa87-ad5f5553acc6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:20.580274 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a9113d05-5c76-4f66-aa87-ad5f5553acc6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:20.581374 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a9113d05-5c76-4f66-aa87-ad5f5553acc6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:20.581819 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a9113d05-5c76-4f66-aa87-ad5f5553acc6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:20.588663 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-873845945", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-577368355", "security_groups": [{"name": "tempest-secgroup-smoke-763362693"}], "block_device_mapping_v2": [{"uuid": "021865d2-edcf-4b98-8ce0-d3cbab2818fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5af0e6ef-b600-4363-b491-e83498d1d2b9"}]}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:20.754153 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.network.neutron [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] validate_networks() for [('5af0e6ef-b600-4363-b491-e83498d1d2b9', None, None, None, None, None)] {{(pid=116183) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:31:20.759178 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a9113d05-5c76-4f66-aa87-ad5f5553acc6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:20.767912 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a9113d05-5c76-4f66-aa87-ad5f5553acc6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:20.769692 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a9113d05-5c76-4f66-aa87-ad5f5553acc6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:20.770886 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a9113d05-5c76-4f66-aa87-ad5f5553acc6 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.203010 Jan 17 21:31:20.771454 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 574/1144] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:20 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:21.155087 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Flavor limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:31:21.155551 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Image limits 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:31:21.156033 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Flavor pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:31:21.156483 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Image pref 0:0:0 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:31:21.156904 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.virt.hardware [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116183) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:31:21.165649 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:21.166105 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:21.166930 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:21.167379 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:21.185171 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Getting quotas for project 97b00002d33945c6a8056483b241fbf6. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:31:21.190311 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Getting quotas for user 0cd489955c19471891724ec1badc11ee and project 97b00002d33945c6a8056483b241fbf6. Resources: {'ram', 'instances', 'cores'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:31:21.247139 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Going to run 1 instances... {{(pid=116183) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:31:21.249364 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='021865d2-edcf-4b98-8ce0-d3cbab2818fb',volume_size=None,volume_type=None)] {{(pid=116183) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:31:21.404949 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-94d36b49-468a-40d5-a3f8-97b7fbaf66bb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.820619 Jan 17 21:31:21.405812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 571/1145] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:31:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 17 21:31:21.416947 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-afc5948f-07bf-455c-8a2b-57bda846eedf tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:21.417693 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-afc5948f-07bf-455c-8a2b-57bda846eedf tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:21.474063 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-afc5948f-07bf-455c-8a2b-57bda846eedf tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:21.481451 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-afc5948f-07bf-455c-8a2b-57bda846eedf tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1093 microversion: 2.1 time: 0.068859 Jan 17 21:31:21.482038 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 575/1146] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:21 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:21.790278 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-dc3f0c26-3b3b-4cd9-828c-1d6a52769aca tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:21.790847 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-dc3f0c26-3b3b-4cd9-828c-1d6a52769aca tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:21.798020 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dc3f0c26-3b3b-4cd9-828c-1d6a52769aca tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:21.798559 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dc3f0c26-3b3b-4cd9-828c-1d6a52769aca tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:21.799378 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dc3f0c26-3b3b-4cd9-828c-1d6a52769aca tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:21.799828 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dc3f0c26-3b3b-4cd9-828c-1d6a52769aca tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:21.943245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-dc3f0c26-3b3b-4cd9-828c-1d6a52769aca tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:21.951440 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-dc3f0c26-3b3b-4cd9-828c-1d6a52769aca tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:21.952970 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-dc3f0c26-3b3b-4cd9-828c-1d6a52769aca tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:21.954134 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-dc3f0c26-3b3b-4cd9-828c-1d6a52769aca tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.168336 Jan 17 21:31:21.955206 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 572/1147] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:21 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:22.505762 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-987a760b-dbb7-4e54-9ad9-960c409669cd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:22.506455 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-987a760b-dbb7-4e54-9ad9-960c409669cd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:22.564549 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-987a760b-dbb7-4e54-9ad9-960c409669cd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:22.573330 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-987a760b-dbb7-4e54-9ad9-960c409669cd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1093 microversion: 2.1 time: 0.071354 Jan 17 21:31:22.573893 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 576/1148] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:22 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:22.973155 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ed2e1f44-eaec-4fa3-aea9-0fc0389da743 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:22.973763 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ed2e1f44-eaec-4fa3-aea9-0fc0389da743 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:22.980072 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ed2e1f44-eaec-4fa3-aea9-0fc0389da743 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:22.980560 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ed2e1f44-eaec-4fa3-aea9-0fc0389da743 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:22.981342 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ed2e1f44-eaec-4fa3-aea9-0fc0389da743 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:22.981775 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ed2e1f44-eaec-4fa3-aea9-0fc0389da743 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:23.112332 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ed2e1f44-eaec-4fa3-aea9-0fc0389da743 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:23.120260 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ed2e1f44-eaec-4fa3-aea9-0fc0389da743 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:23.121807 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ed2e1f44-eaec-4fa3-aea9-0fc0389da743 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:23.122960 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ed2e1f44-eaec-4fa3-aea9-0fc0389da743 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.153575 Jan 17 21:31:23.123515 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 573/1149] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:22 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:23.590713 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1b8d3f00-59dd-4660-932b-fd7ab54bf7a8 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:23.591335 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1b8d3f00-59dd-4660-932b-fd7ab54bf7a8 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:23.644608 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1b8d3f00-59dd-4660-932b-fd7ab54bf7a8 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:23.651370 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1b8d3f00-59dd-4660-932b-fd7ab54bf7a8 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1093 microversion: 2.1 time: 0.064261 Jan 17 21:31:23.651932 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 577/1150] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:23 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:24.141423 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2b15b562-4933-4440-82c8-739bf39b5596 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:24.142590 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2b15b562-4933-4440-82c8-739bf39b5596 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:24.149061 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2b15b562-4933-4440-82c8-739bf39b5596 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:24.149512 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2b15b562-4933-4440-82c8-739bf39b5596 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:24.150447 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2b15b562-4933-4440-82c8-739bf39b5596 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:24.150889 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2b15b562-4933-4440-82c8-739bf39b5596 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:24.286193 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2b15b562-4933-4440-82c8-739bf39b5596 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:24.294315 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2b15b562-4933-4440-82c8-739bf39b5596 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:24.295816 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2b15b562-4933-4440-82c8-739bf39b5596 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:24.297016 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2b15b562-4933-4440-82c8-739bf39b5596 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.159354 Jan 17 21:31:24.297597 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 574/1151] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:24 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:31:24.668802 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-9a92c234-e008-4206-b7c6-c08e50f4bcbd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:24.669422 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-9a92c234-e008-4206-b7c6-c08e50f4bcbd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:24.746961 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-9a92c234-e008-4206-b7c6-c08e50f4bcbd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:24.755982 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-9a92c234-e008-4206-b7c6-c08e50f4bcbd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1093 microversion: 2.1 time: 0.090377 Jan 17 21:31:24.763435 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 578/1152] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:24 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1093 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:25.314442 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-54bb5342-fd2c-4d1a-9e8a-fcd2a9db6b00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:25.314967 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-54bb5342-fd2c-4d1a-9e8a-fcd2a9db6b00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:25.321294 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-54bb5342-fd2c-4d1a-9e8a-fcd2a9db6b00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:25.321747 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-54bb5342-fd2c-4d1a-9e8a-fcd2a9db6b00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:25.322528 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-54bb5342-fd2c-4d1a-9e8a-fcd2a9db6b00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:25.322973 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-54bb5342-fd2c-4d1a-9e8a-fcd2a9db6b00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:25.451008 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-54bb5342-fd2c-4d1a-9e8a-fcd2a9db6b00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:25.459075 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-54bb5342-fd2c-4d1a-9e8a-fcd2a9db6b00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:25.460631 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-54bb5342-fd2c-4d1a-9e8a-fcd2a9db6b00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:25.461780 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-54bb5342-fd2c-4d1a-9e8a-fcd2a9db6b00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.151166 Jan 17 21:31:25.462330 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 575/1153] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:25 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:25.774542 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-878c39e8-8a75-4b05-90af-1b9ffbea13de tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:25.775158 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-878c39e8-8a75-4b05-90af-1b9ffbea13de tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:25.781726 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-878c39e8-8a75-4b05-90af-1b9ffbea13de tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:25.782189 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-878c39e8-8a75-4b05-90af-1b9ffbea13de tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:25.783640 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-878c39e8-8a75-4b05-90af-1b9ffbea13de tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:25.784087 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-878c39e8-8a75-4b05-90af-1b9ffbea13de tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:25.844190 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-878c39e8-8a75-4b05-90af-1b9ffbea13de tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:25.859722 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-878c39e8-8a75-4b05-90af-1b9ffbea13de tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1143 microversion: 2.1 time: 0.088249 Jan 17 21:31:25.860927 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 579/1154] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:25 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:26.483145 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4c89a83a-f410-4790-b319-5b658e82e00d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:26.483873 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4c89a83a-f410-4790-b319-5b658e82e00d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:26.491087 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c89a83a-f410-4790-b319-5b658e82e00d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:26.492364 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c89a83a-f410-4790-b319-5b658e82e00d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:26.493297 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c89a83a-f410-4790-b319-5b658e82e00d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:26.493809 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c89a83a-f410-4790-b319-5b658e82e00d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:26.632089 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4c89a83a-f410-4790-b319-5b658e82e00d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:26.640145 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4c89a83a-f410-4790-b319-5b658e82e00d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:26.641903 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4c89a83a-f410-4790-b319-5b658e82e00d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:26.643067 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4c89a83a-f410-4790-b319-5b658e82e00d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.165079 Jan 17 21:31:26.643628 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 576/1155] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:26 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:26.877178 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-da1605d6-ffd6-4300-b3b9-1c2b3b4db2af tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:26.877799 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-da1605d6-ffd6-4300-b3b9-1c2b3b4db2af tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:26.884570 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-da1605d6-ffd6-4300-b3b9-1c2b3b4db2af tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:26.885268 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-da1605d6-ffd6-4300-b3b9-1c2b3b4db2af tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:26.886224 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-da1605d6-ffd6-4300-b3b9-1c2b3b4db2af tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:26.886661 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-da1605d6-ffd6-4300-b3b9-1c2b3b4db2af tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:26.949615 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-da1605d6-ffd6-4300-b3b9-1c2b3b4db2af tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:26.958684 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-da1605d6-ffd6-4300-b3b9-1c2b3b4db2af tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1209 microversion: 2.1 time: 0.085266 Jan 17 21:31:26.959518 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 580/1156] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:26 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:27.660634 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7776da3d-0a53-42f0-a15f-2dda4894aa19 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:27.661247 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7776da3d-0a53-42f0-a15f-2dda4894aa19 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:27.670550 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7776da3d-0a53-42f0-a15f-2dda4894aa19 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:27.671887 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7776da3d-0a53-42f0-a15f-2dda4894aa19 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:27.672895 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7776da3d-0a53-42f0-a15f-2dda4894aa19 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:27.673334 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7776da3d-0a53-42f0-a15f-2dda4894aa19 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:27.774895 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-04b94959-bf8b-4a4e-aa6d-f43058057da4 req-84413ca9-c662-46a3-8e16-f7cdd8734d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b36124-78c9-4d6c-a106-743e642f28ea", "tag": "d25d6980-4925-4e8f-bed1-d6d5051f37ce"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:27.776775 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:31:27.776775 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:31:27.784067 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-04b94959-bf8b-4a4e-aa6d-f43058057da4 req-84413ca9-c662-46a3-8e16-f7cdd8734d1b service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:27.784557 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-04b94959-bf8b-4a4e-aa6d-f43058057da4 req-84413ca9-c662-46a3-8e16-f7cdd8734d1b service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:27.799168 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-04b94959-bf8b-4a4e-aa6d-f43058057da4 req-84413ca9-c662-46a3-8e16-f7cdd8734d1b service nova] Creating event network-changed:d25d6980-4925-4e8f-bed1-d6d5051f37ce for instance a8b36124-78c9-4d6c-a106-743e642f28ea on hv-cinder-82489 Jan 17 21:31:27.815355 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-04b94959-bf8b-4a4e-aa6d-f43058057da4 req-84413ca9-c662-46a3-8e16-f7cdd8734d1b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044130 Jan 17 21:31:27.820573 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 581/1157] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:31:27.846032 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7776da3d-0a53-42f0-a15f-2dda4894aa19 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:27.855964 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7776da3d-0a53-42f0-a15f-2dda4894aa19 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:27.857538 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7776da3d-0a53-42f0-a15f-2dda4894aa19 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:27.858748 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7776da3d-0a53-42f0-a15f-2dda4894aa19 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1743 microversion: 2.20 time: 0.202002 Jan 17 21:31:27.859324 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 577/1158] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:27 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1743 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:27.983032 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a883f9c6-1cce-4754-a1e9-925a0e92663c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:27.983032 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a883f9c6-1cce-4754-a1e9-925a0e92663c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:27.988116 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a883f9c6-1cce-4754-a1e9-925a0e92663c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:27.988860 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a883f9c6-1cce-4754-a1e9-925a0e92663c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:27.989730 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a883f9c6-1cce-4754-a1e9-925a0e92663c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:27.990243 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a883f9c6-1cce-4754-a1e9-925a0e92663c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:28.135207 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a883f9c6-1cce-4754-a1e9-925a0e92663c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:28.143828 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a883f9c6-1cce-4754-a1e9-925a0e92663c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1264 microversion: 2.1 time: 0.169792 Jan 17 21:31:28.144463 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 582/1159] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:27 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:28.877820 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a9c1362a-0e05-4fce-871c-b6d65ee17e4b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:28.878363 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a9c1362a-0e05-4fce-871c-b6d65ee17e4b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:28.884859 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a9c1362a-0e05-4fce-871c-b6d65ee17e4b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:28.885319 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a9c1362a-0e05-4fce-871c-b6d65ee17e4b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:28.886114 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a9c1362a-0e05-4fce-871c-b6d65ee17e4b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:28.886559 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a9c1362a-0e05-4fce-871c-b6d65ee17e4b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:29.019525 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-a9c1362a-0e05-4fce-871c-b6d65ee17e4b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:29.027186 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-a9c1362a-0e05-4fce-871c-b6d65ee17e4b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:29.028697 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-a9c1362a-0e05-4fce-871c-b6d65ee17e4b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:29.029841 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a9c1362a-0e05-4fce-871c-b6d65ee17e4b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1743 microversion: 2.20 time: 0.156417 Jan 17 21:31:29.030385 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 578/1160] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:28 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:29.160692 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1fe6aae1-e7dd-492d-9742-2a1e991bb80b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:29.161254 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1fe6aae1-e7dd-492d-9742-2a1e991bb80b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:29.167698 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1fe6aae1-e7dd-492d-9742-2a1e991bb80b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:29.168159 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1fe6aae1-e7dd-492d-9742-2a1e991bb80b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:29.168972 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1fe6aae1-e7dd-492d-9742-2a1e991bb80b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:29.169419 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1fe6aae1-e7dd-492d-9742-2a1e991bb80b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:29.306402 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-1fe6aae1-e7dd-492d-9742-2a1e991bb80b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:29.314321 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1fe6aae1-e7dd-492d-9742-2a1e991bb80b tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1264 microversion: 2.1 time: 0.156823 Jan 17 21:31:29.314887 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 583/1161] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:29 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:30.048079 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3c069ef8-09ed-4837-b6e1-b8c5cdd1e90d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:30.048650 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3c069ef8-09ed-4837-b6e1-b8c5cdd1e90d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:30.054849 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c069ef8-09ed-4837-b6e1-b8c5cdd1e90d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:30.055795 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c069ef8-09ed-4837-b6e1-b8c5cdd1e90d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:30.056051 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c069ef8-09ed-4837-b6e1-b8c5cdd1e90d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:30.056518 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3c069ef8-09ed-4837-b6e1-b8c5cdd1e90d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:30.185711 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3c069ef8-09ed-4837-b6e1-b8c5cdd1e90d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:30.194150 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3c069ef8-09ed-4837-b6e1-b8c5cdd1e90d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:30.195655 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3c069ef8-09ed-4837-b6e1-b8c5cdd1e90d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:30.196855 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3c069ef8-09ed-4837-b6e1-b8c5cdd1e90d tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1743 microversion: 2.20 time: 0.152691 Jan 17 21:31:30.197420 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 579/1162] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:30 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:30.331210 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7cff7215-626f-4495-ada9-7c731d11462d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:30.331727 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7cff7215-626f-4495-ada9-7c731d11462d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:30.337990 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7cff7215-626f-4495-ada9-7c731d11462d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:30.338433 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7cff7215-626f-4495-ada9-7c731d11462d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:30.339216 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7cff7215-626f-4495-ada9-7c731d11462d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:30.339649 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7cff7215-626f-4495-ada9-7c731d11462d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:30.471171 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7cff7215-626f-4495-ada9-7c731d11462d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:30.478439 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7cff7215-626f-4495-ada9-7c731d11462d tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1264 microversion: 2.1 time: 0.151255 Jan 17 21:31:30.479007 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 584/1163] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:30 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:31.214849 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1fb30a5e-f880-4ec9-b405-772ded3f82c4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:31.215434 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1fb30a5e-f880-4ec9-b405-772ded3f82c4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:31.222391 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1fb30a5e-f880-4ec9-b405-772ded3f82c4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:31.222848 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1fb30a5e-f880-4ec9-b405-772ded3f82c4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:31.223633 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1fb30a5e-f880-4ec9-b405-772ded3f82c4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:31.224069 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1fb30a5e-f880-4ec9-b405-772ded3f82c4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:31.269421 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-2ba1be49-9061-48c8-80a2-4f125f897da6 req-1a643124-cbf4-4e28-8e00-84b5bdb4ea81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc3ee12-556d-4522-9fae-d6c208109ee4", "name": "network-vif-plugged", "status": "completed", "tag": "8aacd03c-92eb-4738-865d-606ef0ff4559"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:31.271103 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:31:31.271103 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:31:31.279588 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-2ba1be49-9061-48c8-80a2-4f125f897da6 req-1a643124-cbf4-4e28-8e00-84b5bdb4ea81 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:31.280113 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-2ba1be49-9061-48c8-80a2-4f125f897da6 req-1a643124-cbf4-4e28-8e00-84b5bdb4ea81 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:31.292698 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-2ba1be49-9061-48c8-80a2-4f125f897da6 req-1a643124-cbf4-4e28-8e00-84b5bdb4ea81 service nova] Creating event network-vif-plugged:8aacd03c-92eb-4738-865d-606ef0ff4559 for instance 0bc3ee12-556d-4522-9fae-d6c208109ee4 on hv-cinder-82489 Jan 17 21:31:31.297943 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-2ba1be49-9061-48c8-80a2-4f125f897da6 req-1a643124-cbf4-4e28-8e00-84b5bdb4ea81 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033010 Jan 17 21:31:31.298815 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 585/1164] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:31:31.359677 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1fb30a5e-f880-4ec9-b405-772ded3f82c4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:31.367603 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1fb30a5e-f880-4ec9-b405-772ded3f82c4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:31.369198 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1fb30a5e-f880-4ec9-b405-772ded3f82c4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:31.370342 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1fb30a5e-f880-4ec9-b405-772ded3f82c4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1743 microversion: 2.20 time: 0.159182 Jan 17 21:31:31.370926 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 580/1165] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:31 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:31.496638 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-bce6650d-c7b9-4b79-9c7e-78441408568e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:31.497345 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-bce6650d-c7b9-4b79-9c7e-78441408568e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:31.504041 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bce6650d-c7b9-4b79-9c7e-78441408568e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:31.504530 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bce6650d-c7b9-4b79-9c7e-78441408568e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:31.505315 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bce6650d-c7b9-4b79-9c7e-78441408568e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:31.505757 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bce6650d-c7b9-4b79-9c7e-78441408568e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:31.637045 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-bce6650d-c7b9-4b79-9c7e-78441408568e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:31.644454 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-bce6650d-c7b9-4b79-9c7e-78441408568e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1264 microversion: 2.1 time: 0.152251 Jan 17 21:31:31.645022 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 586/1166] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:31 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:32.388890 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-358e569c-124f-4deb-bcbb-e532277abb82 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:32.389500 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-358e569c-124f-4deb-bcbb-e532277abb82 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:32.395791 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-358e569c-124f-4deb-bcbb-e532277abb82 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:32.396236 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-358e569c-124f-4deb-bcbb-e532277abb82 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:32.397036 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-358e569c-124f-4deb-bcbb-e532277abb82 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:32.397471 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-358e569c-124f-4deb-bcbb-e532277abb82 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:32.527154 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-358e569c-124f-4deb-bcbb-e532277abb82 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:32.534975 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-358e569c-124f-4deb-bcbb-e532277abb82 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:32.536498 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-358e569c-124f-4deb-bcbb-e532277abb82 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:32.537648 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-358e569c-124f-4deb-bcbb-e532277abb82 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1743 microversion: 2.20 time: 0.152455 Jan 17 21:31:32.538196 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 581/1167] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:32 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:32.661517 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-94040906-72af-4feb-9cf3-007d31efd779 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:32.662050 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-94040906-72af-4feb-9cf3-007d31efd779 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:32.668259 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-94040906-72af-4feb-9cf3-007d31efd779 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:32.668749 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-94040906-72af-4feb-9cf3-007d31efd779 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:32.669526 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-94040906-72af-4feb-9cf3-007d31efd779 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:32.669962 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-94040906-72af-4feb-9cf3-007d31efd779 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:32.802928 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-94040906-72af-4feb-9cf3-007d31efd779 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:32.810248 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-94040906-72af-4feb-9cf3-007d31efd779 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1264 microversion: 2.1 time: 0.153039 Jan 17 21:31:32.810811 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 587/1168] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:32 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:33.556822 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1c8c1412-a077-4316-b778-1ba4060d0b0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:33.557713 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1c8c1412-a077-4316-b778-1ba4060d0b0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:33.564948 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1c8c1412-a077-4316-b778-1ba4060d0b0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:33.565406 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1c8c1412-a077-4316-b778-1ba4060d0b0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:33.566193 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1c8c1412-a077-4316-b778-1ba4060d0b0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:33.566630 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1c8c1412-a077-4316-b778-1ba4060d0b0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:33.747506 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1c8c1412-a077-4316-b778-1ba4060d0b0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:33.756745 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1c8c1412-a077-4316-b778-1ba4060d0b0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:33.758350 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1c8c1412-a077-4316-b778-1ba4060d0b0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:33.759634 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1c8c1412-a077-4316-b778-1ba4060d0b0f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1738 microversion: 2.20 time: 0.206582 Jan 17 21:31:33.760261 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 582/1169] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:33 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:33.827119 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-da061c52-c2a9-4511-8e37-68c0b3580cf4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:33.828451 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-da061c52-c2a9-4511-8e37-68c0b3580cf4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:33.836279 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-da061c52-c2a9-4511-8e37-68c0b3580cf4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:33.836875 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-da061c52-c2a9-4511-8e37-68c0b3580cf4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:33.837764 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-da061c52-c2a9-4511-8e37-68c0b3580cf4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:33.838461 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-da061c52-c2a9-4511-8e37-68c0b3580cf4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:33.988260 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-da061c52-c2a9-4511-8e37-68c0b3580cf4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:33.999844 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-da061c52-c2a9-4511-8e37-68c0b3580cf4 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1264 microversion: 2.1 time: 0.177113 Jan 17 21:31:34.000769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 588/1170] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:33 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:31:34.780680 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-200300d8-1278-4d4f-bb89-9b4798cf18ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:34.781353 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-200300d8-1278-4d4f-bb89-9b4798cf18ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:34.788337 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-200300d8-1278-4d4f-bb89-9b4798cf18ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:34.788967 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-200300d8-1278-4d4f-bb89-9b4798cf18ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:34.790019 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-200300d8-1278-4d4f-bb89-9b4798cf18ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:34.790559 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-200300d8-1278-4d4f-bb89-9b4798cf18ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:34.931286 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-200300d8-1278-4d4f-bb89-9b4798cf18ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:34.939181 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-200300d8-1278-4d4f-bb89-9b4798cf18ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:34.941080 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-200300d8-1278-4d4f-bb89-9b4798cf18ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:34.942449 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-200300d8-1278-4d4f-bb89-9b4798cf18ef tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1738 microversion: 2.20 time: 0.165695 Jan 17 21:31:34.953066 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 583/1171] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:34 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:35.017072 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-983b1031-b8cf-493c-a228-e22ef81295a8 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:35.018369 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-983b1031-b8cf-493c-a228-e22ef81295a8 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:35.025086 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-983b1031-b8cf-493c-a228-e22ef81295a8 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:35.026873 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-983b1031-b8cf-493c-a228-e22ef81295a8 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:35.026873 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-983b1031-b8cf-493c-a228-e22ef81295a8 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:35.026873 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-983b1031-b8cf-493c-a228-e22ef81295a8 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:35.175353 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-983b1031-b8cf-493c-a228-e22ef81295a8 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:35.182971 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-983b1031-b8cf-493c-a228-e22ef81295a8 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1264 microversion: 2.1 time: 0.169649 Jan 17 21:31:35.183537 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 589/1172] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:35 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:35.963313 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ebb8de50-0b0c-4c84-b721-49629fc89a61 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:35.965778 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ebb8de50-0b0c-4c84-b721-49629fc89a61 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:35.974510 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebb8de50-0b0c-4c84-b721-49629fc89a61 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:35.974966 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebb8de50-0b0c-4c84-b721-49629fc89a61 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:35.975977 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebb8de50-0b0c-4c84-b721-49629fc89a61 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:35.976443 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ebb8de50-0b0c-4c84-b721-49629fc89a61 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:36.154352 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ebb8de50-0b0c-4c84-b721-49629fc89a61 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:36.163941 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ebb8de50-0b0c-4c84-b721-49629fc89a61 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:36.165523 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ebb8de50-0b0c-4c84-b721-49629fc89a61 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:36.166688 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ebb8de50-0b0c-4c84-b721-49629fc89a61 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1738 microversion: 2.20 time: 0.209349 Jan 17 21:31:36.167256 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 584/1173] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:35 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:36.199144 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0dc3f659-404d-4330-90f3-0026a87a947f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:36.199797 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0dc3f659-404d-4330-90f3-0026a87a947f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:36.206675 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0dc3f659-404d-4330-90f3-0026a87a947f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:36.207146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0dc3f659-404d-4330-90f3-0026a87a947f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:36.207945 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0dc3f659-404d-4330-90f3-0026a87a947f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:36.208414 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0dc3f659-404d-4330-90f3-0026a87a947f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:36.373912 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-0dc3f659-404d-4330-90f3-0026a87a947f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:36.382846 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0dc3f659-404d-4330-90f3-0026a87a947f tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1264 microversion: 2.1 time: 0.187567 Jan 17 21:31:36.383514 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 590/1174] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:36 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:37.187125 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-444b1379-a70c-4264-80b5-108d5dc5d6f3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:37.189169 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-444b1379-a70c-4264-80b5-108d5dc5d6f3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:37.200241 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-444b1379-a70c-4264-80b5-108d5dc5d6f3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:37.201820 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-444b1379-a70c-4264-80b5-108d5dc5d6f3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:37.204245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-444b1379-a70c-4264-80b5-108d5dc5d6f3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:37.205561 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-444b1379-a70c-4264-80b5-108d5dc5d6f3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:37.377391 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-444b1379-a70c-4264-80b5-108d5dc5d6f3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:37.385861 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-444b1379-a70c-4264-80b5-108d5dc5d6f3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:37.388110 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-444b1379-a70c-4264-80b5-108d5dc5d6f3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:37.389556 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-444b1379-a70c-4264-80b5-108d5dc5d6f3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1738 microversion: 2.20 time: 0.206982 Jan 17 21:31:37.400833 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 585/1175] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:37 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:37.412838 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a952ab7a-e857-491f-ac00-a7e2033f2012 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:37.414678 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a952ab7a-e857-491f-ac00-a7e2033f2012 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:37.425156 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a952ab7a-e857-491f-ac00-a7e2033f2012 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:37.426071 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a952ab7a-e857-491f-ac00-a7e2033f2012 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:37.427016 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a952ab7a-e857-491f-ac00-a7e2033f2012 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:37.427550 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a952ab7a-e857-491f-ac00-a7e2033f2012 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:37.625209 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a952ab7a-e857-491f-ac00-a7e2033f2012 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:37.634308 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a952ab7a-e857-491f-ac00-a7e2033f2012 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1264 microversion: 2.1 time: 0.227946 Jan 17 21:31:37.635509 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 591/1176] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:37 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:38.415378 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0c30b710-2e0f-4a48-8d59-2d1f2881b1e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:38.415989 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-0c30b710-2e0f-4a48-8d59-2d1f2881b1e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:38.425945 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0c30b710-2e0f-4a48-8d59-2d1f2881b1e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:38.426633 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0c30b710-2e0f-4a48-8d59-2d1f2881b1e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:38.427603 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0c30b710-2e0f-4a48-8d59-2d1f2881b1e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:38.428204 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0c30b710-2e0f-4a48-8d59-2d1f2881b1e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:38.585320 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-0c30b710-2e0f-4a48-8d59-2d1f2881b1e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:38.593332 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-0c30b710-2e0f-4a48-8d59-2d1f2881b1e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:38.595633 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-0c30b710-2e0f-4a48-8d59-2d1f2881b1e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:38.597135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-0c30b710-2e0f-4a48-8d59-2d1f2881b1e5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1738 microversion: 2.20 time: 0.186446 Jan 17 21:31:38.597983 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 586/1177] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:38 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:31:38.724610 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5e4d17be-8846-47b5-9cc3-c937716bc4bd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:38.725819 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5e4d17be-8846-47b5-9cc3-c937716bc4bd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:38.732052 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5e4d17be-8846-47b5-9cc3-c937716bc4bd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:38.732543 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5e4d17be-8846-47b5-9cc3-c937716bc4bd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:38.733343 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5e4d17be-8846-47b5-9cc3-c937716bc4bd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:38.733784 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5e4d17be-8846-47b5-9cc3-c937716bc4bd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:38.882677 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5e4d17be-8846-47b5-9cc3-c937716bc4bd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:38.890590 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5e4d17be-8846-47b5-9cc3-c937716bc4bd tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1264 microversion: 2.1 time: 0.170681 Jan 17 21:31:38.900236 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 592/1178] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:38 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:39.341800 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-570f5608-711e-42e2-a0e6-9506b47c3c16 req-c5e11418-6674-4bec-9ff2-23a56caea662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b36124-78c9-4d6c-a106-743e642f28ea", "name": "network-vif-plugged", "status": "completed", "tag": "d25d6980-4925-4e8f-bed1-d6d5051f37ce"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:39.344506 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:31:39.344506 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:31:39.353980 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-570f5608-711e-42e2-a0e6-9506b47c3c16 req-c5e11418-6674-4bec-9ff2-23a56caea662 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:39.354168 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-570f5608-711e-42e2-a0e6-9506b47c3c16 req-c5e11418-6674-4bec-9ff2-23a56caea662 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:39.365673 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-570f5608-711e-42e2-a0e6-9506b47c3c16 req-c5e11418-6674-4bec-9ff2-23a56caea662 service nova] Creating event network-vif-plugged:d25d6980-4925-4e8f-bed1-d6d5051f37ce for instance a8b36124-78c9-4d6c-a106-743e642f28ea on hv-cinder-82489 Jan 17 21:31:39.371558 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-570f5608-711e-42e2-a0e6-9506b47c3c16 req-c5e11418-6674-4bec-9ff2-23a56caea662 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034966 Jan 17 21:31:39.372603 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 587/1179] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:31:39.615864 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-80b66979-0d4d-472c-897e-5d0f93f4b42c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:39.616690 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-80b66979-0d4d-472c-897e-5d0f93f4b42c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:39.623274 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-80b66979-0d4d-472c-897e-5d0f93f4b42c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:39.623829 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-80b66979-0d4d-472c-897e-5d0f93f4b42c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:39.624774 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-80b66979-0d4d-472c-897e-5d0f93f4b42c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:39.625297 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-80b66979-0d4d-472c-897e-5d0f93f4b42c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:39.772975 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-80b66979-0d4d-472c-897e-5d0f93f4b42c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:39.783253 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-80b66979-0d4d-472c-897e-5d0f93f4b42c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:39.785360 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-80b66979-0d4d-472c-897e-5d0f93f4b42c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:39.786787 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-80b66979-0d4d-472c-897e-5d0f93f4b42c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1738 microversion: 2.20 time: 0.174724 Jan 17 21:31:39.798219 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 593/1180] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:39 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:39.907987 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-bd138d18-b329-444d-ab9f-b9f7c2cb9184 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:39.908817 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-bd138d18-b329-444d-ab9f-b9f7c2cb9184 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:39.915052 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bd138d18-b329-444d-ab9f-b9f7c2cb9184 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:39.915513 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bd138d18-b329-444d-ab9f-b9f7c2cb9184 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:39.916309 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bd138d18-b329-444d-ab9f-b9f7c2cb9184 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:39.917067 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bd138d18-b329-444d-ab9f-b9f7c2cb9184 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:40.078455 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-bd138d18-b329-444d-ab9f-b9f7c2cb9184 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:40.087951 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-bd138d18-b329-444d-ab9f-b9f7c2cb9184 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1264 microversion: 2.1 time: 0.184385 Jan 17 21:31:40.088554 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 588/1181] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:39 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:40.805318 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-99de5603-0ed7-45e5-817a-9891730911e3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:40.806713 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-99de5603-0ed7-45e5-817a-9891730911e3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:40.813339 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99de5603-0ed7-45e5-817a-9891730911e3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:40.814156 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99de5603-0ed7-45e5-817a-9891730911e3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:40.815298 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99de5603-0ed7-45e5-817a-9891730911e3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:40.816052 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-99de5603-0ed7-45e5-817a-9891730911e3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:40.969925 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-99de5603-0ed7-45e5-817a-9891730911e3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:40.984150 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-99de5603-0ed7-45e5-817a-9891730911e3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:40.988236 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-99de5603-0ed7-45e5-817a-9891730911e3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:40.990040 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-99de5603-0ed7-45e5-817a-9891730911e3 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1738 microversion: 2.20 time: 0.188629 Jan 17 21:31:40.990600 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 594/1182] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:40 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:41.106479 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a0c01b8c-839a-4ab8-9906-baf7dfbf06fe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:41.107100 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a0c01b8c-839a-4ab8-9906-baf7dfbf06fe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:41.115041 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a0c01b8c-839a-4ab8-9906-baf7dfbf06fe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:41.116044 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a0c01b8c-839a-4ab8-9906-baf7dfbf06fe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:41.117005 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a0c01b8c-839a-4ab8-9906-baf7dfbf06fe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:41.117517 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a0c01b8c-839a-4ab8-9906-baf7dfbf06fe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:41.277436 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-a0c01b8c-839a-4ab8-9906-baf7dfbf06fe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:41.286932 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a0c01b8c-839a-4ab8-9906-baf7dfbf06fe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1264 microversion: 2.1 time: 0.184136 Jan 17 21:31:41.289128 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 589/1183] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:41 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:42.008542 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2b1dadf3-d22d-4290-9e97-f957eb4b3f95 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:42.009902 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2b1dadf3-d22d-4290-9e97-f957eb4b3f95 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:42.017190 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2b1dadf3-d22d-4290-9e97-f957eb4b3f95 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:42.017646 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2b1dadf3-d22d-4290-9e97-f957eb4b3f95 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:42.018467 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2b1dadf3-d22d-4290-9e97-f957eb4b3f95 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:42.018919 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2b1dadf3-d22d-4290-9e97-f957eb4b3f95 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:42.181951 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2b1dadf3-d22d-4290-9e97-f957eb4b3f95 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:42.191368 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2b1dadf3-d22d-4290-9e97-f957eb4b3f95 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:42.192891 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2b1dadf3-d22d-4290-9e97-f957eb4b3f95 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:42.194303 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2b1dadf3-d22d-4290-9e97-f957eb4b3f95 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1738 microversion: 2.20 time: 0.190016 Jan 17 21:31:42.195052 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 595/1184] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:42 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:31:42.304740 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-049a5ea2-788a-4f34-abbd-c66f9b3cba63 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:42.305770 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-049a5ea2-788a-4f34-abbd-c66f9b3cba63 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:42.312426 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-049a5ea2-788a-4f34-abbd-c66f9b3cba63 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:42.313157 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-049a5ea2-788a-4f34-abbd-c66f9b3cba63 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:42.314763 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-049a5ea2-788a-4f34-abbd-c66f9b3cba63 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:42.315359 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-049a5ea2-788a-4f34-abbd-c66f9b3cba63 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:42.465969 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-049a5ea2-788a-4f34-abbd-c66f9b3cba63 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:42.474457 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-049a5ea2-788a-4f34-abbd-c66f9b3cba63 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1451 microversion: 2.1 time: 0.173558 Jan 17 21:31:42.475028 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 590/1185] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:42 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1451 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:42.491631 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ce5ff169-a2af-4a38-8ca5-c050d1a3d07e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:42.492680 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ce5ff169-a2af-4a38-8ca5-c050d1a3d07e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:42.499003 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ce5ff169-a2af-4a38-8ca5-c050d1a3d07e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:42.499544 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ce5ff169-a2af-4a38-8ca5-c050d1a3d07e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:42.500578 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ce5ff169-a2af-4a38-8ca5-c050d1a3d07e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:42.501090 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ce5ff169-a2af-4a38-8ca5-c050d1a3d07e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:42.667425 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ce5ff169-a2af-4a38-8ca5-c050d1a3d07e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:42.676102 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ce5ff169-a2af-4a38-8ca5-c050d1a3d07e tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1451 microversion: 2.1 time: 0.188030 Jan 17 21:31:42.677605 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 596/1186] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:31:42 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1451 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:31:43.224821 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-99e15a33-5ba1-4744-893b-d1a23bf365f5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:43.225791 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-99e15a33-5ba1-4744-893b-d1a23bf365f5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:43.233288 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-99e15a33-5ba1-4744-893b-d1a23bf365f5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:43.235349 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-99e15a33-5ba1-4744-893b-d1a23bf365f5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:43.236790 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-99e15a33-5ba1-4744-893b-d1a23bf365f5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:43.237252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-99e15a33-5ba1-4744-893b-d1a23bf365f5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:43.452215 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-99e15a33-5ba1-4744-893b-d1a23bf365f5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:43.471590 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-99e15a33-5ba1-4744-893b-d1a23bf365f5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:43.473448 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-99e15a33-5ba1-4744-893b-d1a23bf365f5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:43.474922 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-99e15a33-5ba1-4744-893b-d1a23bf365f5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1738 microversion: 2.20 time: 0.253947 Jan 17 21:31:43.476185 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 591/1187] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:43 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1738 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:44.494030 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-944442df-1a4d-4696-9113-5af30ae9ed00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:44.494710 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-944442df-1a4d-4696-9113-5af30ae9ed00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:44.501791 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-944442df-1a4d-4696-9113-5af30ae9ed00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:44.502242 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-944442df-1a4d-4696-9113-5af30ae9ed00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:44.503031 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-944442df-1a4d-4696-9113-5af30ae9ed00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:44.503473 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-944442df-1a4d-4696-9113-5af30ae9ed00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:44.637718 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-944442df-1a4d-4696-9113-5af30ae9ed00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:44.646029 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-944442df-1a4d-4696-9113-5af30ae9ed00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:44.647544 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-944442df-1a4d-4696-9113-5af30ae9ed00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:44.648749 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-944442df-1a4d-4696-9113-5af30ae9ed00 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1738 microversion: 2.20 time: 0.159177 Jan 17 21:31:44.649312 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 597/1188] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:44 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:44.919941 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-5b9624ce-003d-4cb9-a047-1575fb1c2eb5 req-e56b48e1-e910-410e-84db-639b66d147a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b36124-78c9-4d6c-a106-743e642f28ea", "tag": "d25d6980-4925-4e8f-bed1-d6d5051f37ce"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:44.922096 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:31:44.922096 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:31:44.930207 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-5b9624ce-003d-4cb9-a047-1575fb1c2eb5 req-e56b48e1-e910-410e-84db-639b66d147a2 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:44.930901 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-5b9624ce-003d-4cb9-a047-1575fb1c2eb5 req-e56b48e1-e910-410e-84db-639b66d147a2 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:44.942420 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-5b9624ce-003d-4cb9-a047-1575fb1c2eb5 req-e56b48e1-e910-410e-84db-639b66d147a2 service nova] Creating event network-changed:d25d6980-4925-4e8f-bed1-d6d5051f37ce for instance a8b36124-78c9-4d6c-a106-743e642f28ea on hv-cinder-82489 Jan 17 21:31:44.947887 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-5b9624ce-003d-4cb9-a047-1575fb1c2eb5 req-e56b48e1-e910-410e-84db-639b66d147a2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031665 Jan 17 21:31:44.949667 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 592/1189] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:31:45.666963 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4ab22694-99b4-45d3-892a-adae682c92d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:45.667585 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4ab22694-99b4-45d3-892a-adae682c92d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:45.674508 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4ab22694-99b4-45d3-892a-adae682c92d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:45.674966 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4ab22694-99b4-45d3-892a-adae682c92d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:45.675991 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4ab22694-99b4-45d3-892a-adae682c92d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:45.676643 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4ab22694-99b4-45d3-892a-adae682c92d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:45.828648 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4ab22694-99b4-45d3-892a-adae682c92d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:45.838879 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4ab22694-99b4-45d3-892a-adae682c92d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:45.840512 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4ab22694-99b4-45d3-892a-adae682c92d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:45.841763 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4ab22694-99b4-45d3-892a-adae682c92d1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1720 microversion: 2.20 time: 0.178576 Jan 17 21:31:45.842574 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 598/1190] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:45 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:46.871418 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5b598f60-4895-4f78-9b86-cbe88fff912e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:46.872170 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5b598f60-4895-4f78-9b86-cbe88fff912e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:46.878742 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5b598f60-4895-4f78-9b86-cbe88fff912e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:46.879200 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5b598f60-4895-4f78-9b86-cbe88fff912e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:46.879978 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5b598f60-4895-4f78-9b86-cbe88fff912e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:46.880437 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5b598f60-4895-4f78-9b86-cbe88fff912e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:47.011412 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5b598f60-4895-4f78-9b86-cbe88fff912e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:47.019380 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5b598f60-4895-4f78-9b86-cbe88fff912e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:47.020950 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5b598f60-4895-4f78-9b86-cbe88fff912e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:47.022115 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5b598f60-4895-4f78-9b86-cbe88fff912e tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1720 microversion: 2.20 time: 0.154817 Jan 17 21:31:47.022680 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 593/1191] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:46 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:48.041069 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-cb0c804c-a536-4392-91f2-4779f316484c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:48.041678 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-cb0c804c-a536-4392-91f2-4779f316484c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:48.048020 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cb0c804c-a536-4392-91f2-4779f316484c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:48.048513 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cb0c804c-a536-4392-91f2-4779f316484c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:48.049312 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cb0c804c-a536-4392-91f2-4779f316484c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:48.049757 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cb0c804c-a536-4392-91f2-4779f316484c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:48.181101 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-cb0c804c-a536-4392-91f2-4779f316484c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:48.188764 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-cb0c804c-a536-4392-91f2-4779f316484c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:48.190248 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-cb0c804c-a536-4392-91f2-4779f316484c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:48.191384 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-cb0c804c-a536-4392-91f2-4779f316484c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1663 microversion: 2.20 time: 0.154303 Jan 17 21:31:48.191940 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 599/1192] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:48 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:48.209365 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-17fbb088-e59a-4c3b-a1de-42026721e63b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e8b7602-8bb0-46e5-87cc-c16334fc0fb8"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:48.210360 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-17fbb088-e59a-4c3b-a1de-42026721e63b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:48.216672 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17fbb088-e59a-4c3b-a1de-42026721e63b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:48.217131 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17fbb088-e59a-4c3b-a1de-42026721e63b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:48.220187 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17fbb088-e59a-4c3b-a1de-42026721e63b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:48.220187 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-17fbb088-e59a-4c3b-a1de-42026721e63b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:48.477928 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-17fbb088-e59a-4c3b-a1de-42026721e63b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.272502 Jan 17 21:31:48.478553 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 594/1193] 10.222.0.64 () {62 vars in 1363 bytes} [Mon Jan 17 21:31:48 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/os-volume_attachments => generated 188 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:31:48.589059 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1f00b518-07a7-48f4-9820-04f1b1903303 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:48.589561 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1f00b518-07a7-48f4-9820-04f1b1903303 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:48.596095 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1f00b518-07a7-48f4-9820-04f1b1903303 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:48.596571 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1f00b518-07a7-48f4-9820-04f1b1903303 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:48.597395 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1f00b518-07a7-48f4-9820-04f1b1903303 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:48.597843 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1f00b518-07a7-48f4-9820-04f1b1903303 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:48.826892 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1f00b518-07a7-48f4-9820-04f1b1903303 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/os-volume_attachments/8e8b7602-8bb0-46e5-87cc-c16334fc0fb8" status: 202 len: 0 microversion: 2.20 time: 0.241574 Jan 17 21:31:48.827485 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 600/1194] 10.222.0.64 () {60 vars in 1456 bytes} [Mon Jan 17 21:31:48 2022] DELETE /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/os-volume_attachments/8e8b7602-8bb0-46e5-87cc-c16334fc0fb8 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:31:48.881034 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a7c794bf-1ba8-4d75-9d2f-715bb4d04baa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:48.881606 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a7c794bf-1ba8-4d75-9d2f-715bb4d04baa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:48.887518 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a7c794bf-1ba8-4d75-9d2f-715bb4d04baa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:48.887978 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a7c794bf-1ba8-4d75-9d2f-715bb4d04baa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:48.888797 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a7c794bf-1ba8-4d75-9d2f-715bb4d04baa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:48.889243 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a7c794bf-1ba8-4d75-9d2f-715bb4d04baa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:48.982919 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a7c794bf-1ba8-4d75-9d2f-715bb4d04baa tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action" status: 202 len: 0 microversion: 2.20 time: 0.105412 Jan 17 21:31:48.986679 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 595/1195] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jan 17 21:31:48 2022] POST /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:31:48.991416 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-cd0495cc-77d4-4427-80b1-83efc911a876 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:48.992051 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-cd0495cc-77d4-4427-80b1-83efc911a876 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:48.997929 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cd0495cc-77d4-4427-80b1-83efc911a876 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:48.998450 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cd0495cc-77d4-4427-80b1-83efc911a876 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:48.999319 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cd0495cc-77d4-4427-80b1-83efc911a876 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:48.999823 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cd0495cc-77d4-4427-80b1-83efc911a876 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:49.136765 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-cd0495cc-77d4-4427-80b1-83efc911a876 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:49.145564 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-cd0495cc-77d4-4427-80b1-83efc911a876 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:49.147062 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-cd0495cc-77d4-4427-80b1-83efc911a876 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:49.148205 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-cd0495cc-77d4-4427-80b1-83efc911a876 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1671 microversion: 2.20 time: 0.160483 Jan 17 21:31:49.148816 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 601/1196] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:48 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:49.355999 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-357427ba-12cc-4c35-bf07-5d76536bd177 req-432bc56f-5024-400a-98c0-98c6fb0b3830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc3ee12-556d-4522-9fae-d6c208109ee4", "name": "network-vif-unplugged", "status": "completed", "tag": "8aacd03c-92eb-4738-865d-606ef0ff4559"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:31:49.357677 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:31:49.357677 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:31:49.365568 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-357427ba-12cc-4c35-bf07-5d76536bd177 req-432bc56f-5024-400a-98c0-98c6fb0b3830 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:49.366025 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-357427ba-12cc-4c35-bf07-5d76536bd177 req-432bc56f-5024-400a-98c0-98c6fb0b3830 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:49.379624 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.compute.server_external_events [req-357427ba-12cc-4c35-bf07-5d76536bd177 req-432bc56f-5024-400a-98c0-98c6fb0b3830 service nova] Unable to find a host for instance 0bc3ee12-556d-4522-9fae-d6c208109ee4. Dropping event network-vif-unplugged {{(pid=116183) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 17 21:31:49.380555 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-357427ba-12cc-4c35-bf07-5d76536bd177 req-432bc56f-5024-400a-98c0-98c6fb0b3830 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028817 Jan 17 21:31:49.381153 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 596/1197] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 17 21:31:50.166580 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-123321b0-3e2f-45a4-95fd-f5f96a807d4f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:50.167196 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-123321b0-3e2f-45a4-95fd-f5f96a807d4f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:50.173523 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-123321b0-3e2f-45a4-95fd-f5f96a807d4f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:50.173982 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-123321b0-3e2f-45a4-95fd-f5f96a807d4f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:50.174772 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-123321b0-3e2f-45a4-95fd-f5f96a807d4f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:50.175220 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-123321b0-3e2f-45a4-95fd-f5f96a807d4f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:50.306036 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-123321b0-3e2f-45a4-95fd-f5f96a807d4f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:50.314580 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-123321b0-3e2f-45a4-95fd-f5f96a807d4f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:50.316089 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-123321b0-3e2f-45a4-95fd-f5f96a807d4f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:50.317291 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-123321b0-3e2f-45a4-95fd-f5f96a807d4f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.154423 Jan 17 21:31:50.317858 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 602/1198] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:50 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:51.336008 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-59effc43-9cec-4571-a591-9246f5986e51 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:51.336614 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-59effc43-9cec-4571-a591-9246f5986e51 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:51.343450 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-59effc43-9cec-4571-a591-9246f5986e51 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:51.343899 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-59effc43-9cec-4571-a591-9246f5986e51 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:51.345581 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-59effc43-9cec-4571-a591-9246f5986e51 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:51.346093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-59effc43-9cec-4571-a591-9246f5986e51 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:51.503704 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-59effc43-9cec-4571-a591-9246f5986e51 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:51.512291 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-59effc43-9cec-4571-a591-9246f5986e51 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:51.515235 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-59effc43-9cec-4571-a591-9246f5986e51 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:51.517249 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-59effc43-9cec-4571-a591-9246f5986e51 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.185570 Jan 17 21:31:51.517991 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 597/1199] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:51 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:52.538239 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-63b070c1-63a6-4f8d-be3b-738d16d0955f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:52.539549 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-63b070c1-63a6-4f8d-be3b-738d16d0955f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:52.548209 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63b070c1-63a6-4f8d-be3b-738d16d0955f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:52.548703 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63b070c1-63a6-4f8d-be3b-738d16d0955f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:52.549510 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63b070c1-63a6-4f8d-be3b-738d16d0955f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:52.549957 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63b070c1-63a6-4f8d-be3b-738d16d0955f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:52.687851 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-63b070c1-63a6-4f8d-be3b-738d16d0955f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:52.695767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-63b070c1-63a6-4f8d-be3b-738d16d0955f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:52.697319 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-63b070c1-63a6-4f8d-be3b-738d16d0955f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:52.698475 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-63b070c1-63a6-4f8d-be3b-738d16d0955f tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.166883 Jan 17 21:31:52.699033 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 603/1200] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:52 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:53.718639 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5e8ea367-9af7-4b44-b0b8-ed1e062f0662 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:53.720656 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5e8ea367-9af7-4b44-b0b8-ed1e062f0662 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:53.728271 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5e8ea367-9af7-4b44-b0b8-ed1e062f0662 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:53.729264 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5e8ea367-9af7-4b44-b0b8-ed1e062f0662 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:53.730113 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5e8ea367-9af7-4b44-b0b8-ed1e062f0662 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:53.730562 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5e8ea367-9af7-4b44-b0b8-ed1e062f0662 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:53.870943 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5e8ea367-9af7-4b44-b0b8-ed1e062f0662 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:53.878748 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5e8ea367-9af7-4b44-b0b8-ed1e062f0662 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:53.880247 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5e8ea367-9af7-4b44-b0b8-ed1e062f0662 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:53.881444 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5e8ea367-9af7-4b44-b0b8-ed1e062f0662 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.167355 Jan 17 21:31:53.881996 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 598/1201] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:53 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:54.899223 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-38e12e96-1230-49b8-9352-987cebc70ef2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:54.900166 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-38e12e96-1230-49b8-9352-987cebc70ef2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:54.908104 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-38e12e96-1230-49b8-9352-987cebc70ef2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:54.912205 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-38e12e96-1230-49b8-9352-987cebc70ef2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:54.913267 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-38e12e96-1230-49b8-9352-987cebc70ef2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:54.913860 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-38e12e96-1230-49b8-9352-987cebc70ef2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:55.064979 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-38e12e96-1230-49b8-9352-987cebc70ef2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:55.072868 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-38e12e96-1230-49b8-9352-987cebc70ef2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:55.074375 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-38e12e96-1230-49b8-9352-987cebc70ef2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:55.075560 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-38e12e96-1230-49b8-9352-987cebc70ef2 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.180072 Jan 17 21:31:55.076120 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 604/1202] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:54 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:56.094675 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-71be4d3c-4eb5-4358-b367-b260f91b3d7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:56.095522 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-71be4d3c-4eb5-4358-b367-b260f91b3d7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:56.101799 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-71be4d3c-4eb5-4358-b367-b260f91b3d7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:56.102252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-71be4d3c-4eb5-4358-b367-b260f91b3d7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:56.103047 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-71be4d3c-4eb5-4358-b367-b260f91b3d7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:56.103486 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-71be4d3c-4eb5-4358-b367-b260f91b3d7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:56.246892 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-71be4d3c-4eb5-4358-b367-b260f91b3d7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:56.256531 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-71be4d3c-4eb5-4358-b367-b260f91b3d7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:56.258020 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-71be4d3c-4eb5-4358-b367-b260f91b3d7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:56.259300 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-71be4d3c-4eb5-4358-b367-b260f91b3d7a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.168386 Jan 17 21:31:56.259860 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 599/1203] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:56 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:57.277271 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-37df1d0a-ff45-4acd-975a-412edd7996c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:57.277942 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-37df1d0a-ff45-4acd-975a-412edd7996c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:57.284201 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-37df1d0a-ff45-4acd-975a-412edd7996c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:57.284759 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-37df1d0a-ff45-4acd-975a-412edd7996c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:57.285633 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-37df1d0a-ff45-4acd-975a-412edd7996c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:57.286153 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-37df1d0a-ff45-4acd-975a-412edd7996c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:57.428072 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-37df1d0a-ff45-4acd-975a-412edd7996c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:57.436514 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-37df1d0a-ff45-4acd-975a-412edd7996c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:57.438061 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-37df1d0a-ff45-4acd-975a-412edd7996c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:57.439258 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-37df1d0a-ff45-4acd-975a-412edd7996c1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.165775 Jan 17 21:31:57.449862 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 605/1204] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:57 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:58.458391 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4b197e75-dd66-41b6-a11c-3e67e27fa96c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:58.459268 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4b197e75-dd66-41b6-a11c-3e67e27fa96c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:58.466948 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4b197e75-dd66-41b6-a11c-3e67e27fa96c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:58.467404 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4b197e75-dd66-41b6-a11c-3e67e27fa96c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:58.468209 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4b197e75-dd66-41b6-a11c-3e67e27fa96c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:58.468678 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4b197e75-dd66-41b6-a11c-3e67e27fa96c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:58.605100 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4b197e75-dd66-41b6-a11c-3e67e27fa96c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:58.613207 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4b197e75-dd66-41b6-a11c-3e67e27fa96c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:58.614737 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4b197e75-dd66-41b6-a11c-3e67e27fa96c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:58.615895 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4b197e75-dd66-41b6-a11c-3e67e27fa96c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.161590 Jan 17 21:31:58.616492 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 600/1205] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:58 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:31:59.634944 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-60feec31-c302-43dd-b35c-199d005937e0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:31:59.635554 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-60feec31-c302-43dd-b35c-199d005937e0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:31:59.642664 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60feec31-c302-43dd-b35c-199d005937e0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:59.643117 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60feec31-c302-43dd-b35c-199d005937e0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:59.643945 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60feec31-c302-43dd-b35c-199d005937e0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:31:59.644339 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-60feec31-c302-43dd-b35c-199d005937e0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:31:59.787493 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-60feec31-c302-43dd-b35c-199d005937e0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:59.795300 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-60feec31-c302-43dd-b35c-199d005937e0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:59.796836 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-60feec31-c302-43dd-b35c-199d005937e0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:31:59.798002 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-60feec31-c302-43dd-b35c-199d005937e0 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.166761 Jan 17 21:31:59.798560 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 606/1206] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:31:59 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:32:00.816922 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-bc17ae9c-c791-4563-a753-16476788e295 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:32:00.817475 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-bc17ae9c-c791-4563-a753-16476788e295 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:32:00.823703 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bc17ae9c-c791-4563-a753-16476788e295 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:00.824153 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bc17ae9c-c791-4563-a753-16476788e295 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:00.824957 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bc17ae9c-c791-4563-a753-16476788e295 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:00.825393 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bc17ae9c-c791-4563-a753-16476788e295 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:00.951195 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-bc17ae9c-c791-4563-a753-16476788e295 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:00.959280 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-bc17ae9c-c791-4563-a753-16476788e295 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:00.960817 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-bc17ae9c-c791-4563-a753-16476788e295 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:00.961983 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-bc17ae9c-c791-4563-a753-16476788e295 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.149467 Jan 17 21:32:00.962543 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 601/1207] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:32:00 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:32:01.980176 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d5d0f944-8cce-436c-aaee-78e2212534c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:32:01.980841 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d5d0f944-8cce-436c-aaee-78e2212534c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:32:01.987255 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d5d0f944-8cce-436c-aaee-78e2212534c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:01.987714 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d5d0f944-8cce-436c-aaee-78e2212534c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:01.988544 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d5d0f944-8cce-436c-aaee-78e2212534c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:01.988991 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d5d0f944-8cce-436c-aaee-78e2212534c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:02.117137 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d5d0f944-8cce-436c-aaee-78e2212534c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:02.125073 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d5d0f944-8cce-436c-aaee-78e2212534c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:02.127105 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d5d0f944-8cce-436c-aaee-78e2212534c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:02.128569 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d5d0f944-8cce-436c-aaee-78e2212534c7 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.152075 Jan 17 21:32:02.129145 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 607/1208] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:32:01 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:32:03.145913 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-998cf771-075c-47a5-a356-03903de81abe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:32:03.146515 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-998cf771-075c-47a5-a356-03903de81abe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:32:03.152640 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-998cf771-075c-47a5-a356-03903de81abe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:03.153106 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-998cf771-075c-47a5-a356-03903de81abe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:03.154235 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-998cf771-075c-47a5-a356-03903de81abe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:03.154792 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-998cf771-075c-47a5-a356-03903de81abe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:03.284618 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-998cf771-075c-47a5-a356-03903de81abe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:03.292442 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-998cf771-075c-47a5-a356-03903de81abe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:03.293950 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-998cf771-075c-47a5-a356-03903de81abe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:03.295100 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-998cf771-075c-47a5-a356-03903de81abe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.152883 Jan 17 21:32:03.295659 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 602/1209] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:32:03 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:32:03.837956 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:32:03.838565 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: Mon Jan 17 21:32:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 21:32:04.313979 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2f356ad2-80d0-418f-9a42-993c9ffb6ccb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:32:04.314618 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2f356ad2-80d0-418f-9a42-993c9ffb6ccb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:32:04.320991 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2f356ad2-80d0-418f-9a42-993c9ffb6ccb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:04.321450 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2f356ad2-80d0-418f-9a42-993c9ffb6ccb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:04.322233 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2f356ad2-80d0-418f-9a42-993c9ffb6ccb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:04.322678 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2f356ad2-80d0-418f-9a42-993c9ffb6ccb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:04.449857 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2f356ad2-80d0-418f-9a42-993c9ffb6ccb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:04.458252 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2f356ad2-80d0-418f-9a42-993c9ffb6ccb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:04.459737 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2f356ad2-80d0-418f-9a42-993c9ffb6ccb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:04.460936 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2f356ad2-80d0-418f-9a42-993c9ffb6ccb tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.150746 Jan 17 21:32:04.461477 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 608/1210] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:32:04 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:32:05.479809 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9161ef77-b884-4938-8dbd-35f96546e16a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:32:05.480451 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-9161ef77-b884-4938-8dbd-35f96546e16a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:32:05.487235 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9161ef77-b884-4938-8dbd-35f96546e16a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:05.487692 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9161ef77-b884-4938-8dbd-35f96546e16a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:05.488507 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9161ef77-b884-4938-8dbd-35f96546e16a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:05.488960 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9161ef77-b884-4938-8dbd-35f96546e16a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:05.617880 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-9161ef77-b884-4938-8dbd-35f96546e16a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:05.625587 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-9161ef77-b884-4938-8dbd-35f96546e16a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:05.627177 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-9161ef77-b884-4938-8dbd-35f96546e16a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:05.628326 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-9161ef77-b884-4938-8dbd-35f96546e16a tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.152237 Jan 17 21:32:05.628922 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 603/1211] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:32:05 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:32:06.646143 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2c7d3ac4-de5a-43fa-9e7d-0c266608c7e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:32:06.646721 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2c7d3ac4-de5a-43fa-9e7d-0c266608c7e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:32:06.653192 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2c7d3ac4-de5a-43fa-9e7d-0c266608c7e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:06.653639 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2c7d3ac4-de5a-43fa-9e7d-0c266608c7e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:06.654411 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2c7d3ac4-de5a-43fa-9e7d-0c266608c7e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:06.654847 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2c7d3ac4-de5a-43fa-9e7d-0c266608c7e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:06.783736 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2c7d3ac4-de5a-43fa-9e7d-0c266608c7e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:06.792208 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2c7d3ac4-de5a-43fa-9e7d-0c266608c7e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:06.793722 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-2c7d3ac4-de5a-43fa-9e7d-0c266608c7e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:06.794871 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2c7d3ac4-de5a-43fa-9e7d-0c266608c7e4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.152493 Jan 17 21:32:06.795745 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 609/1212] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:32:06 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:32:07.813563 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-55895c01-f9bc-4b0b-89f1-7512ff5f2fa5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:32:07.814227 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-55895c01-f9bc-4b0b-89f1-7512ff5f2fa5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:32:07.820349 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-55895c01-f9bc-4b0b-89f1-7512ff5f2fa5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:07.820834 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-55895c01-f9bc-4b0b-89f1-7512ff5f2fa5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:07.821614 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-55895c01-f9bc-4b0b-89f1-7512ff5f2fa5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:07.822061 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-55895c01-f9bc-4b0b-89f1-7512ff5f2fa5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:07.949758 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-55895c01-f9bc-4b0b-89f1-7512ff5f2fa5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:07.957802 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-55895c01-f9bc-4b0b-89f1-7512ff5f2fa5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:07.959300 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-55895c01-f9bc-4b0b-89f1-7512ff5f2fa5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:07.960483 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-55895c01-f9bc-4b0b-89f1-7512ff5f2fa5 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.151212 Jan 17 21:32:07.961275 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 604/1213] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:32:07 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:32:08.738978 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:32:08.739666 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: Mon Jan 17 21:32:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 21:32:08.979023 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a458b81b-3a5b-4d4d-a0b3-6f0e31bd4b67 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:32:08.979649 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a458b81b-3a5b-4d4d-a0b3-6f0e31bd4b67 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:32:08.987021 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a458b81b-3a5b-4d4d-a0b3-6f0e31bd4b67 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:08.987419 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a458b81b-3a5b-4d4d-a0b3-6f0e31bd4b67 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:08.988221 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a458b81b-3a5b-4d4d-a0b3-6f0e31bd4b67 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:08.988705 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a458b81b-3a5b-4d4d-a0b3-6f0e31bd4b67 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:09.123044 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a458b81b-3a5b-4d4d-a0b3-6f0e31bd4b67 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:09.131742 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a458b81b-3a5b-4d4d-a0b3-6f0e31bd4b67 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:09.133280 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-a458b81b-3a5b-4d4d-a0b3-6f0e31bd4b67 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:09.134460 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a458b81b-3a5b-4d4d-a0b3-6f0e31bd4b67 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.159304 Jan 17 21:32:09.135013 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 610/1214] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:32:08 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:32:09.482189 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-4529b7b7-0b2a-4ead-b243-f635cf494015 req-2844cdbe-b9bf-45cc-8fbe-7d23e7fe0764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc3ee12-556d-4522-9fae-d6c208109ee4", "name": "network-vif-plugged", "status": "completed", "tag": "8aacd03c-92eb-4738-865d-606ef0ff4559"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:32:09.483822 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:32:09.483822 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:32:09.492497 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-4529b7b7-0b2a-4ead-b243-f635cf494015 req-2844cdbe-b9bf-45cc-8fbe-7d23e7fe0764 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:09.493121 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-4529b7b7-0b2a-4ead-b243-f635cf494015 req-2844cdbe-b9bf-45cc-8fbe-7d23e7fe0764 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:09.505445 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-4529b7b7-0b2a-4ead-b243-f635cf494015 req-2844cdbe-b9bf-45cc-8fbe-7d23e7fe0764 service nova] Creating event network-vif-plugged:8aacd03c-92eb-4738-865d-606ef0ff4559 for instance 0bc3ee12-556d-4522-9fae-d6c208109ee4 on hv-cinder-82489 Jan 17 21:32:09.510450 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-4529b7b7-0b2a-4ead-b243-f635cf494015 req-2844cdbe-b9bf-45cc-8fbe-7d23e7fe0764 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031878 Jan 17 21:32:09.511216 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 605/1215] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:32:10.152987 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-11651365-bac3-4aaa-a328-52bbabe93f26 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:32:10.153601 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-11651365-bac3-4aaa-a328-52bbabe93f26 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:32:10.160926 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-11651365-bac3-4aaa-a328-52bbabe93f26 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:10.161383 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-11651365-bac3-4aaa-a328-52bbabe93f26 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:10.162182 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-11651365-bac3-4aaa-a328-52bbabe93f26 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:10.162630 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-11651365-bac3-4aaa-a328-52bbabe93f26 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:10.301015 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-11651365-bac3-4aaa-a328-52bbabe93f26 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:10.308849 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-11651365-bac3-4aaa-a328-52bbabe93f26 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:10.310347 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-11651365-bac3-4aaa-a328-52bbabe93f26 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:10.311499 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-11651365-bac3-4aaa-a328-52bbabe93f26 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.162324 Jan 17 21:32:10.312055 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 611/1216] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:32:10 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 17 21:32:11.329155 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a63cb26c-93db-40eb-80af-8726c27126fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:32:11.329956 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a63cb26c-93db-40eb-80af-8726c27126fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:32:11.336850 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a63cb26c-93db-40eb-80af-8726c27126fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:11.337385 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a63cb26c-93db-40eb-80af-8726c27126fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:11.338180 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a63cb26c-93db-40eb-80af-8726c27126fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:11.338622 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a63cb26c-93db-40eb-80af-8726c27126fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:11.474573 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-a63cb26c-93db-40eb-80af-8726c27126fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:11.483263 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-a63cb26c-93db-40eb-80af-8726c27126fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:11.485733 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-a63cb26c-93db-40eb-80af-8726c27126fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:11.487152 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a63cb26c-93db-40eb-80af-8726c27126fe tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1729 microversion: 2.20 time: 0.162094 Jan 17 21:32:11.487712 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 606/1217] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:32:11 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:32:12.505431 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c677b7bb-957c-4001-89ed-4e7baa4fb45c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:32:12.506037 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c677b7bb-957c-4001-89ed-4e7baa4fb45c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:32:12.512255 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c677b7bb-957c-4001-89ed-4e7baa4fb45c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:12.512729 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c677b7bb-957c-4001-89ed-4e7baa4fb45c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:12.513504 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c677b7bb-957c-4001-89ed-4e7baa4fb45c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:32:12.513941 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c677b7bb-957c-4001-89ed-4e7baa4fb45c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:32:12.643236 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c677b7bb-957c-4001-89ed-4e7baa4fb45c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:12.650950 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c677b7bb-957c-4001-89ed-4e7baa4fb45c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:12.652480 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-c677b7bb-957c-4001-89ed-4e7baa4fb45c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:32:12.653634 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c677b7bb-957c-4001-89ed-4e7baa4fb45c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1716 microversion: 2.20 time: 0.151861 Jan 17 21:32:12.654195 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 612/1218] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:32:12 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:33:08.147541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f0ae97f4-0a68-4d3d-bb62-507bb3bdc088 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:08.148525 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f0ae97f4-0a68-4d3d-bb62-507bb3bdc088 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:08.154458 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f0ae97f4-0a68-4d3d-bb62-507bb3bdc088 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:08.154917 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f0ae97f4-0a68-4d3d-bb62-507bb3bdc088 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:08.155707 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f0ae97f4-0a68-4d3d-bb62-507bb3bdc088 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:08.156154 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f0ae97f4-0a68-4d3d-bb62-507bb3bdc088 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:08.185669 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f0ae97f4-0a68-4d3d-bb62-507bb3bdc088 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041989 Jan 17 21:33:08.186231 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 607/1219] 10.222.0.64 () {60 vars in 1342 bytes} [Mon Jan 17 21:33:08 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:08.244289 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-dc6b406b-e947-4a2c-a56d-be6e57ec90a4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:08.244871 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-dc6b406b-e947-4a2c-a56d-be6e57ec90a4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:08.251551 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dc6b406b-e947-4a2c-a56d-be6e57ec90a4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:08.252017 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dc6b406b-e947-4a2c-a56d-be6e57ec90a4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:08.252853 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dc6b406b-e947-4a2c-a56d-be6e57ec90a4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:08.253301 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dc6b406b-e947-4a2c-a56d-be6e57ec90a4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:08.278883 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-dc6b406b-e947-4a2c-a56d-be6e57ec90a4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Going to try to terminate instance {{(pid=116182) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:33:08.355648 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-dc6b406b-e947-4a2c-a56d-be6e57ec90a4 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 204 len: 0 microversion: 2.20 time: 0.114648 Jan 17 21:33:08.356363 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 613/1220] 10.222.0.64 () {60 vars in 1279 bytes} [Mon Jan 17 21:33:08 2022] DELETE /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 17 21:33:08.365047 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2f3cd7bb-ccf5-4c5f-b63a-04ebcc23c92c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:08.365662 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2f3cd7bb-ccf5-4c5f-b63a-04ebcc23c92c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:08.371589 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2f3cd7bb-ccf5-4c5f-b63a-04ebcc23c92c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:08.372051 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2f3cd7bb-ccf5-4c5f-b63a-04ebcc23c92c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:08.372878 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2f3cd7bb-ccf5-4c5f-b63a-04ebcc23c92c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:08.373326 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2f3cd7bb-ccf5-4c5f-b63a-04ebcc23c92c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:08.518070 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2f3cd7bb-ccf5-4c5f-b63a-04ebcc23c92c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:08.525872 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2f3cd7bb-ccf5-4c5f-b63a-04ebcc23c92c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:08.527377 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2f3cd7bb-ccf5-4c5f-b63a-04ebcc23c92c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:08.528553 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2f3cd7bb-ccf5-4c5f-b63a-04ebcc23c92c tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.167361 Jan 17 21:33:08.529117 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 608/1221] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:33:08 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:33:09.547088 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4b482b71-0c1d-4c12-8643-871bb765e29b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:09.547790 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4b482b71-0c1d-4c12-8643-871bb765e29b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:09.554160 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4b482b71-0c1d-4c12-8643-871bb765e29b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:09.554613 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4b482b71-0c1d-4c12-8643-871bb765e29b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:09.555403 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4b482b71-0c1d-4c12-8643-871bb765e29b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:09.555844 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4b482b71-0c1d-4c12-8643-871bb765e29b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:09.684242 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4b482b71-0c1d-4c12-8643-871bb765e29b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:09.692680 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4b482b71-0c1d-4c12-8643-871bb765e29b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:09.694183 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-4b482b71-0c1d-4c12-8643-871bb765e29b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:09.695340 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4b482b71-0c1d-4c12-8643-871bb765e29b tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1722 microversion: 2.20 time: 0.152351 Jan 17 21:33:09.695893 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 614/1222] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:33:09 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:33:10.713616 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ac209b44-d190-4771-860f-800b1f814ace tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:10.714236 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ac209b44-d190-4771-860f-800b1f814ace tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:10.722426 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ac209b44-d190-4771-860f-800b1f814ace tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:10.722890 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ac209b44-d190-4771-860f-800b1f814ace tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:10.723760 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ac209b44-d190-4771-860f-800b1f814ace tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:10.724298 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ac209b44-d190-4771-860f-800b1f814ace tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:10.785484 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ac209b44-d190-4771-860f-800b1f814ace tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:10.793826 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ac209b44-d190-4771-860f-800b1f814ace tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:10.795411 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ac209b44-d190-4771-860f-800b1f814ace tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e157700e929e4e569557016122cf47cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3391c884182f46fc99248b8f0ba1822f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:10.796629 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ac209b44-d190-4771-860f-800b1f814ace tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 200 len: 1654 microversion: 2.20 time: 0.086829 Jan 17 21:33:10.805883 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 609/1223] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:33:10 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 1654 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 17 21:33:10.834194 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-ac517ee6-29da-4da0-91bd-3a0178e2eb50 req-63693dd8-cdfa-44fe-ac27-077d6b352227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc3ee12-556d-4522-9fae-d6c208109ee4", "name": "network-vif-deleted", "tag": "8aacd03c-92eb-4738-865d-606ef0ff4559"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:10.836912 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:33:10.836912 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:33:10.846701 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-ac517ee6-29da-4da0-91bd-3a0178e2eb50 req-63693dd8-cdfa-44fe-ac27-077d6b352227 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:10.847152 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-ac517ee6-29da-4da0-91bd-3a0178e2eb50 req-63693dd8-cdfa-44fe-ac27-077d6b352227 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:10.860027 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-ac517ee6-29da-4da0-91bd-3a0178e2eb50 req-63693dd8-cdfa-44fe-ac27-077d6b352227 service nova] Creating event network-vif-deleted:8aacd03c-92eb-4738-865d-606ef0ff4559 for instance 0bc3ee12-556d-4522-9fae-d6c208109ee4 on hv-cinder-82489 Jan 17 21:33:10.865643 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-ac517ee6-29da-4da0-91bd-3a0178e2eb50 req-63693dd8-cdfa-44fe-ac27-077d6b352227 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034895 Jan 17 21:33:10.867163 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 615/1224] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:33:11.815484 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9144d378-f8be-47e6-8785-8d0020069cb8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:11.815897 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-9144d378-f8be-47e6-8785-8d0020069cb8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:11.822185 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9144d378-f8be-47e6-8785-8d0020069cb8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:11.822645 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9144d378-f8be-47e6-8785-8d0020069cb8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:11.823439 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9144d378-f8be-47e6-8785-8d0020069cb8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:11.823891 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9144d378-f8be-47e6-8785-8d0020069cb8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:11.838007 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-9144d378-f8be-47e6-8785-8d0020069cb8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] HTTP exception thrown: Instance 0bc3ee12-556d-4522-9fae-d6c208109ee4 could not be found. Jan 17 21:33:11.838598 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9144d378-f8be-47e6-8785-8d0020069cb8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Returning 404 to user: Instance 0bc3ee12-556d-4522-9fae-d6c208109ee4 could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:33:11.839429 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-9144d378-f8be-47e6-8785-8d0020069cb8 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 404 len: 111 microversion: 2.20 time: 0.028349 Jan 17 21:33:11.839968 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 610/1225] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:33:11 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 17 21:33:11.849539 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3fb79c01-6ee9-4853-ab27-2eddb99cafc1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '.version_select at 0x7f89760a5af0>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:11.872154 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3fb79c01-6ee9-4853-ab27-2eddb99cafc1 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-16905186" status: 204 len: 0 microversion: 2.20 time: 0.026704 Jan 17 21:33:11.872787 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 616/1226] 10.222.0.64 () {60 vars in 1255 bytes} [Mon Jan 17 21:33:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-16905186 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 17 21:33:13.647114 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7872fcbe-e7aa-4edb-9ab2-19905c0b9f02 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:13.647643 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7872fcbe-e7aa-4edb-9ab2-19905c0b9f02 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:13.653878 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7872fcbe-e7aa-4edb-9ab2-19905c0b9f02 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:13.654337 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7872fcbe-e7aa-4edb-9ab2-19905c0b9f02 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:13.655125 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7872fcbe-e7aa-4edb-9ab2-19905c0b9f02 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:13.655570 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7872fcbe-e7aa-4edb-9ab2-19905c0b9f02 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:13.669244 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-7872fcbe-e7aa-4edb-9ab2-19905c0b9f02 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] HTTP exception thrown: Instance 0bc3ee12-556d-4522-9fae-d6c208109ee4 could not be found. Jan 17 21:33:13.669827 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7872fcbe-e7aa-4edb-9ab2-19905c0b9f02 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Returning 404 to user: Instance 0bc3ee12-556d-4522-9fae-d6c208109ee4 could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:33:13.670639 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7872fcbe-e7aa-4edb-9ab2-19905c0b9f02 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 404 len: 111 microversion: 2.20 time: 0.027203 Jan 17 21:33:13.671168 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 611/1227] 10.222.0.64 () {60 vars in 1279 bytes} [Mon Jan 17 21:33:13 2022] DELETE /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 17 21:33:13.680011 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4c8a98df-dafa-43a2-a9fc-ea15f7f45989 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:13.680778 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4c8a98df-dafa-43a2-a9fc-ea15f7f45989 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 0bc3ee12-556d-4522-9fae-d6c208109ee4] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:13.687345 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c8a98df-dafa-43a2-a9fc-ea15f7f45989 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:13.687805 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c8a98df-dafa-43a2-a9fc-ea15f7f45989 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:13.688626 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c8a98df-dafa-43a2-a9fc-ea15f7f45989 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:13.689075 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4c8a98df-dafa-43a2-a9fc-ea15f7f45989 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:13.702259 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-4c8a98df-dafa-43a2-a9fc-ea15f7f45989 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] HTTP exception thrown: Instance 0bc3ee12-556d-4522-9fae-d6c208109ee4 could not be found. Jan 17 21:33:13.702856 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4c8a98df-dafa-43a2-a9fc-ea15f7f45989 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Returning 404 to user: Instance 0bc3ee12-556d-4522-9fae-d6c208109ee4 could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:33:13.704231 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4c8a98df-dafa-43a2-a9fc-ea15f7f45989 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4" status: 404 len: 111 microversion: 2.20 time: 0.028482 Jan 17 21:33:13.704822 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 617/1228] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:33:13 2022] GET /compute/v2.1/servers/0bc3ee12-556d-4522-9fae-d6c208109ee4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 17 21:33:14.832636 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-74282e47-289d-451d-8a97-898f8fc19c08 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:14.833156 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-74282e47-289d-451d-8a97-898f8fc19c08 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:14.839321 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-74282e47-289d-451d-8a97-898f8fc19c08 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:14.839767 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-74282e47-289d-451d-8a97-898f8fc19c08 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:14.840607 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-74282e47-289d-451d-8a97-898f8fc19c08 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:14.841048 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-74282e47-289d-451d-8a97-898f8fc19c08 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:14.854439 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-74282e47-289d-451d-8a97-898f8fc19c08 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] HTTP exception thrown: Instance 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 could not be found. Jan 17 21:33:14.855023 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-74282e47-289d-451d-8a97-898f8fc19c08 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Returning 404 to user: Instance 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:33:14.855853 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-74282e47-289d-451d-8a97-898f8fc19c08 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 404 len: 111 microversion: 2.20 time: 0.027387 Jan 17 21:33:14.856365 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 612/1229] 10.222.0.64 () {60 vars in 1279 bytes} [Mon Jan 17 21:33:14 2022] DELETE /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 17 21:33:14.864824 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c98e0744-5372-4b0f-b2cc-80eede754a60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:14.865444 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c98e0744-5372-4b0f-b2cc-80eede754a60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] [instance: 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:14.871813 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c98e0744-5372-4b0f-b2cc-80eede754a60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:14.872280 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c98e0744-5372-4b0f-b2cc-80eede754a60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:14.873103 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c98e0744-5372-4b0f-b2cc-80eede754a60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:14.873556 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c98e0744-5372-4b0f-b2cc-80eede754a60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:14.886287 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-c98e0744-5372-4b0f-b2cc-80eede754a60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] HTTP exception thrown: Instance 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 could not be found. Jan 17 21:33:14.886863 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c98e0744-5372-4b0f-b2cc-80eede754a60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] Returning 404 to user: Instance 5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:33:14.887682 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c98e0744-5372-4b0f-b2cc-80eede754a60 tempest-AttachVolumeShelveTestJSON-1067771347 tempest-AttachVolumeShelveTestJSON-1067771347-project] 10.222.0.64 "GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96" status: 404 len: 111 microversion: 2.20 time: 0.026622 Jan 17 21:33:14.888218 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 618/1230] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jan 17 21:33:14 2022] GET /compute/v2.1/servers/5edb3c99-d30d-4a2c-8b50-5083b7ea9d96 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 17 21:33:23.505473 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e3f08298-964d-4e50-b3c1-c5172d3820d7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'create', calling method: .version_select at 0x7f897b2ee1f0>, body: {"keypair": {"name": "tempest-keypair-698782818"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:23.519892 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-e3f08298-964d-4e50-b3c1-c5172d3820d7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Getting quotas for project 8b4ad2da51ac441986f9af1c8c6a30c1. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:33:23.524474 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-e3f08298-964d-4e50-b3c1-c5172d3820d7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Getting quotas for user 844c17f7d55f4d66893be8af81851331 and project 8b4ad2da51ac441986f9af1c8c6a30c1. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:33:23.538254 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e3f08298-964d-4e50-b3c1-c5172d3820d7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [24339259-f51c-4926-9321-9d786a9f9e9c] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 17 21:33:24.547128 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO oslo.messaging._drivers.impl_rabbit [None req-e3f08298-964d-4e50-b3c1-c5172d3820d7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [24339259-f51c-4926-9321-9d786a9f9e9c] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 52938. Jan 17 21:33:24.791017 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-e3f08298-964d-4e50-b3c1-c5172d3820d7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Getting quotas for project 8b4ad2da51ac441986f9af1c8c6a30c1. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:33:24.795286 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-e3f08298-964d-4e50-b3c1-c5172d3820d7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Getting quotas for user 844c17f7d55f4d66893be8af81851331 and project 8b4ad2da51ac441986f9af1c8c6a30c1. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:33:24.809155 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e3f08298-964d-4e50-b3c1-c5172d3820d7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.424094 Jan 17 21:33:24.809750 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 613/1231] 10.222.0.64 () {60 vars in 1157 bytes} [Mon Jan 17 21:33:23 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:26.168266 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1326385171", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d83dab97-84dd-4ed1-960a-d73699e6d280"}], "security_groups": [{"name": "tempest-securitygroup--515192156"}], "key_name": "tempest-keypair-698782818", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:26.282945 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.network.neutron [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] validate_networks() for [('d83dab97-84dd-4ed1-960a-d73699e6d280', None, None, None, None, None)] {{(pid=116182) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:33:26.766169 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Flavor limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:33:26.766597 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Image limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:33:26.767073 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Flavor pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:33:26.767487 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Image pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:33:26.767901 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:33:26.777520 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:26.777980 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:26.778811 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:26.779258 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:26.798478 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Getting quotas for project 8b4ad2da51ac441986f9af1c8c6a30c1. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:33:26.802976 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Getting quotas for user 844c17f7d55f4d66893be8af81851331 and project 8b4ad2da51ac441986f9af1c8c6a30c1. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:33:26.815128 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Going to run 1 instances... {{(pid=116182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:33:26.817587 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:33:26.870026 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a1d4cb23-2610-4347-93d1-ae4644b24eb3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.705718 Jan 17 21:33:26.870849 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 619/1232] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:33:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:33:26.881429 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-68a98ed6-4dbf-4d36-8255-97cdcc1b167a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:26.882756 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-68a98ed6-4dbf-4d36-8255-97cdcc1b167a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:26.950601 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-68a98ed6-4dbf-4d36-8255-97cdcc1b167a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:26.958130 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-68a98ed6-4dbf-4d36-8255-97cdcc1b167a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1237 microversion: 2.1 time: 0.080953 Jan 17 21:33:26.960520 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 614/1233] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:26 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:27.975592 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e1958f65-aa8a-401b-ad06-9fa1c6afe34a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:27.977143 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e1958f65-aa8a-401b-ad06-9fa1c6afe34a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:27.986819 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e1958f65-aa8a-401b-ad06-9fa1c6afe34a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:27.987368 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e1958f65-aa8a-401b-ad06-9fa1c6afe34a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:27.988265 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e1958f65-aa8a-401b-ad06-9fa1c6afe34a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:27.988847 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e1958f65-aa8a-401b-ad06-9fa1c6afe34a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:28.057962 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-e1958f65-aa8a-401b-ad06-9fa1c6afe34a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:28.066453 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e1958f65-aa8a-401b-ad06-9fa1c6afe34a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1307 microversion: 2.1 time: 0.095020 Jan 17 21:33:28.067029 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 620/1234] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:27 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:29.085136 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6f287533-c147-44a2-ba22-22458a2d5332 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:29.085787 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6f287533-c147-44a2-ba22-22458a2d5332 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:29.093716 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6f287533-c147-44a2-ba22-22458a2d5332 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:29.094430 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6f287533-c147-44a2-ba22-22458a2d5332 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:29.095230 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6f287533-c147-44a2-ba22-22458a2d5332 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:29.095675 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6f287533-c147-44a2-ba22-22458a2d5332 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:29.242008 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-e269b584-1461-419c-9d37-29eb96f4ce0d req-a45180dd-0f54-4ce6-a865-af7baa247cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e5d4f4-8056-4422-9c56-c4d15421e8ff", "tag": "bc270e6d-36cd-419d-a53e-2a49d7402731"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:29.243795 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:33:29.243795 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:33:29.245691 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6f287533-c147-44a2-ba22-22458a2d5332 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:29.255214 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-e269b584-1461-419c-9d37-29eb96f4ce0d req-a45180dd-0f54-4ce6-a865-af7baa247cae service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:29.256196 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-e269b584-1461-419c-9d37-29eb96f4ce0d req-a45180dd-0f54-4ce6-a865-af7baa247cae service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:29.256363 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6f287533-c147-44a2-ba22-22458a2d5332 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1362 microversion: 2.1 time: 0.176519 Jan 17 21:33:29.258696 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 615/1235] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:29 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:29.269513 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-e269b584-1461-419c-9d37-29eb96f4ce0d req-a45180dd-0f54-4ce6-a865-af7baa247cae service nova] Creating event network-changed:bc270e6d-36cd-419d-a53e-2a49d7402731 for instance 36e5d4f4-8056-4422-9c56-c4d15421e8ff on hv-cinder-82489 Jan 17 21:33:29.274784 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-e269b584-1461-419c-9d37-29eb96f4ce0d req-a45180dd-0f54-4ce6-a865-af7baa247cae service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040982 Jan 17 21:33:29.275379 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 621/1236] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:33:30.274477 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-11b96908-378f-4166-b2e1-22c5b8f2d44c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:30.275084 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-11b96908-378f-4166-b2e1-22c5b8f2d44c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:30.282081 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-11b96908-378f-4166-b2e1-22c5b8f2d44c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:30.282541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-11b96908-378f-4166-b2e1-22c5b8f2d44c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:30.283352 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-11b96908-378f-4166-b2e1-22c5b8f2d44c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:30.283793 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-11b96908-378f-4166-b2e1-22c5b8f2d44c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:30.415105 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-11b96908-378f-4166-b2e1-22c5b8f2d44c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:30.422429 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-11b96908-378f-4166-b2e1-22c5b8f2d44c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1362 microversion: 2.1 time: 0.151596 Jan 17 21:33:30.422998 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 616/1237] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:30 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:31.440515 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-56961a13-1c60-4453-b3c8-43d80346b954 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:31.441214 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-56961a13-1c60-4453-b3c8-43d80346b954 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:31.447291 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-56961a13-1c60-4453-b3c8-43d80346b954 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:31.447741 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-56961a13-1c60-4453-b3c8-43d80346b954 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:31.448559 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-56961a13-1c60-4453-b3c8-43d80346b954 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:31.448994 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-56961a13-1c60-4453-b3c8-43d80346b954 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:31.579690 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-56961a13-1c60-4453-b3c8-43d80346b954 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:31.590484 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-56961a13-1c60-4453-b3c8-43d80346b954 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1362 microversion: 2.1 time: 0.154917 Jan 17 21:33:31.591120 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 622/1238] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:31 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:32.606927 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8356932e-a086-466b-b2f1-1703ae3909be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:32.607546 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8356932e-a086-466b-b2f1-1703ae3909be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:32.614349 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8356932e-a086-466b-b2f1-1703ae3909be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:32.614842 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8356932e-a086-466b-b2f1-1703ae3909be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:32.615872 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8356932e-a086-466b-b2f1-1703ae3909be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:32.616316 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8356932e-a086-466b-b2f1-1703ae3909be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:32.757903 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-8356932e-a086-466b-b2f1-1703ae3909be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:32.765001 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8356932e-a086-466b-b2f1-1703ae3909be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1362 microversion: 2.1 time: 0.161855 Jan 17 21:33:32.765564 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 617/1239] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:32 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:33.782657 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-77a098d2-5a8a-4ed9-9fd5-40e177c07f54 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:33.783264 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-77a098d2-5a8a-4ed9-9fd5-40e177c07f54 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:33.789538 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77a098d2-5a8a-4ed9-9fd5-40e177c07f54 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:33.789990 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77a098d2-5a8a-4ed9-9fd5-40e177c07f54 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:33.790767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77a098d2-5a8a-4ed9-9fd5-40e177c07f54 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:33.791203 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77a098d2-5a8a-4ed9-9fd5-40e177c07f54 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:33.925522 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-77a098d2-5a8a-4ed9-9fd5-40e177c07f54 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:33.932904 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-77a098d2-5a8a-4ed9-9fd5-40e177c07f54 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1362 microversion: 2.1 time: 0.154478 Jan 17 21:33:33.933475 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 623/1240] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:33 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:34.049044 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-b130f8b8-7a82-48e1-9b52-7377fadd4c0e req-15c4d601-e38a-45b1-8a50-fec800ad1d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e5d4f4-8056-4422-9c56-c4d15421e8ff", "name": "network-vif-plugged", "status": "completed", "tag": "bc270e6d-36cd-419d-a53e-2a49d7402731"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:34.050657 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:33:34.050657 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:33:34.057526 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-b130f8b8-7a82-48e1-9b52-7377fadd4c0e req-15c4d601-e38a-45b1-8a50-fec800ad1d9e service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:34.057971 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-b130f8b8-7a82-48e1-9b52-7377fadd4c0e req-15c4d601-e38a-45b1-8a50-fec800ad1d9e service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:34.069124 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-b130f8b8-7a82-48e1-9b52-7377fadd4c0e req-15c4d601-e38a-45b1-8a50-fec800ad1d9e service nova] Creating event network-vif-plugged:bc270e6d-36cd-419d-a53e-2a49d7402731 for instance 36e5d4f4-8056-4422-9c56-c4d15421e8ff on hv-cinder-82489 Jan 17 21:33:34.074192 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-b130f8b8-7a82-48e1-9b52-7377fadd4c0e req-15c4d601-e38a-45b1-8a50-fec800ad1d9e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085243 Jan 17 21:33:34.074847 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 618/1241] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:33:34.955197 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5aa04548-4b40-4a3f-b74c-fb5ff8054acf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:34.956218 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5aa04548-4b40-4a3f-b74c-fb5ff8054acf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:34.964720 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5aa04548-4b40-4a3f-b74c-fb5ff8054acf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:34.965181 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5aa04548-4b40-4a3f-b74c-fb5ff8054acf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:34.965982 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5aa04548-4b40-4a3f-b74c-fb5ff8054acf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:34.966425 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5aa04548-4b40-4a3f-b74c-fb5ff8054acf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:35.096527 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5aa04548-4b40-4a3f-b74c-fb5ff8054acf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:35.104050 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5aa04548-4b40-4a3f-b74c-fb5ff8054acf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1362 microversion: 2.1 time: 0.154602 Jan 17 21:33:35.104662 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 624/1242] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:34 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:36.124586 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-29e3d676-797c-4f60-bf00-92234d2d9a90 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:36.125901 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-29e3d676-797c-4f60-bf00-92234d2d9a90 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:36.132521 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-29e3d676-797c-4f60-bf00-92234d2d9a90 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:36.133044 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-29e3d676-797c-4f60-bf00-92234d2d9a90 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:36.133902 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-29e3d676-797c-4f60-bf00-92234d2d9a90 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:36.134339 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-29e3d676-797c-4f60-bf00-92234d2d9a90 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:36.539245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-29e3d676-797c-4f60-bf00-92234d2d9a90 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:36.546584 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-29e3d676-797c-4f60-bf00-92234d2d9a90 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1548 microversion: 2.1 time: 0.427457 Jan 17 21:33:36.547758 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 619/1243] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:36 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1548 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:36.563131 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b1c8ee9c-956f-48f2-9d8b-e0f261b86de6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:36.563653 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b1c8ee9c-956f-48f2-9d8b-e0f261b86de6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:36.569864 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b1c8ee9c-956f-48f2-9d8b-e0f261b86de6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:36.570319 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b1c8ee9c-956f-48f2-9d8b-e0f261b86de6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:36.571101 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b1c8ee9c-956f-48f2-9d8b-e0f261b86de6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:36.571541 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b1c8ee9c-956f-48f2-9d8b-e0f261b86de6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:36.650891 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b1c8ee9c-956f-48f2-9d8b-e0f261b86de6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091346 Jan 17 21:33:36.651486 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 625/1244] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jan 17 21:33:36 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:33:37.602356 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-eb60c18c-49fe-4ac8-8d2b-d01db1165091 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:37.603287 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-eb60c18c-49fe-4ac8-8d2b-d01db1165091 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:37.609713 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eb60c18c-49fe-4ac8-8d2b-d01db1165091 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:37.610172 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eb60c18c-49fe-4ac8-8d2b-d01db1165091 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:37.610976 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eb60c18c-49fe-4ac8-8d2b-d01db1165091 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:37.611414 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-eb60c18c-49fe-4ac8-8d2b-d01db1165091 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:37.659439 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-d8e201af-91c0-4d89-8e48-f445dc41f74e req-74ba4617-3ba2-4fa5-923b-ea39cce8f2ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e5d4f4-8056-4422-9c56-c4d15421e8ff", "tag": "bc270e6d-36cd-419d-a53e-2a49d7402731"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:37.661156 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:33:37.661156 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:33:37.668214 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-d8e201af-91c0-4d89-8e48-f445dc41f74e req-74ba4617-3ba2-4fa5-923b-ea39cce8f2ee service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:37.668688 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-d8e201af-91c0-4d89-8e48-f445dc41f74e req-74ba4617-3ba2-4fa5-923b-ea39cce8f2ee service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:37.680127 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-d8e201af-91c0-4d89-8e48-f445dc41f74e req-74ba4617-3ba2-4fa5-923b-ea39cce8f2ee service nova] Creating event network-changed:bc270e6d-36cd-419d-a53e-2a49d7402731 for instance 36e5d4f4-8056-4422-9c56-c4d15421e8ff on hv-cinder-82489 Jan 17 21:33:37.681260 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-eb60c18c-49fe-4ac8-8d2b-d01db1165091 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 14 microversion: 2.1 time: 0.090100 Jan 17 21:33:37.684756 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 620/1245] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:37 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:33:37.686866 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-d8e201af-91c0-4d89-8e48-f445dc41f74e req-74ba4617-3ba2-4fa5-923b-ea39cce8f2ee service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093456 Jan 17 21:33:37.687472 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 626/1246] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:33:38.693899 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-934b48aa-c4be-4cfe-9e10-3b90e4a35eb0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:38.694867 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-934b48aa-c4be-4cfe-9e10-3b90e4a35eb0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:38.702390 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-934b48aa-c4be-4cfe-9e10-3b90e4a35eb0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:38.702982 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-934b48aa-c4be-4cfe-9e10-3b90e4a35eb0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:38.704493 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-934b48aa-c4be-4cfe-9e10-3b90e4a35eb0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:38.704932 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-934b48aa-c4be-4cfe-9e10-3b90e4a35eb0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:38.765020 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-934b48aa-c4be-4cfe-9e10-3b90e4a35eb0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 14 microversion: 2.1 time: 0.075278 Jan 17 21:33:38.766201 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 621/1247] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:38 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:33:39.777298 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-458fa989-6339-43d4-bfa0-fc2269c06f0e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:39.778315 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-458fa989-6339-43d4-bfa0-fc2269c06f0e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:39.785047 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-458fa989-6339-43d4-bfa0-fc2269c06f0e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:39.785500 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-458fa989-6339-43d4-bfa0-fc2269c06f0e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:39.786277 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-458fa989-6339-43d4-bfa0-fc2269c06f0e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:39.786718 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-458fa989-6339-43d4-bfa0-fc2269c06f0e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:39.840916 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-458fa989-6339-43d4-bfa0-fc2269c06f0e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 14 microversion: 2.1 time: 0.067963 Jan 17 21:33:39.841536 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 627/1248] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:39 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:33:40.853058 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-96c2782f-fabc-4d7c-805f-06144382a6c7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:40.853963 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-96c2782f-fabc-4d7c-805f-06144382a6c7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:40.861452 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-96c2782f-fabc-4d7c-805f-06144382a6c7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:40.861901 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-96c2782f-fabc-4d7c-805f-06144382a6c7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:40.862672 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-96c2782f-fabc-4d7c-805f-06144382a6c7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:40.863115 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-96c2782f-fabc-4d7c-805f-06144382a6c7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:40.959315 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-96c2782f-fabc-4d7c-805f-06144382a6c7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 14 microversion: 2.1 time: 0.110122 Jan 17 21:33:40.960100 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 622/1249] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:40 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:33:41.970809 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2997ee74-4156-4008-89bf-82c7ca0a0977 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:41.971809 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2997ee74-4156-4008-89bf-82c7ca0a0977 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:41.978663 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2997ee74-4156-4008-89bf-82c7ca0a0977 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:41.979131 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2997ee74-4156-4008-89bf-82c7ca0a0977 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:41.979991 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2997ee74-4156-4008-89bf-82c7ca0a0977 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:41.980458 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2997ee74-4156-4008-89bf-82c7ca0a0977 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:42.041132 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2997ee74-4156-4008-89bf-82c7ca0a0977 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 14 microversion: 2.1 time: 0.074138 Jan 17 21:33:42.041783 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 628/1250] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:41 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:33:43.051726 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d3fbb978-a649-4f97-bd0a-247cb5784bbb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:43.052803 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d3fbb978-a649-4f97-bd0a-247cb5784bbb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:43.060587 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3fbb978-a649-4f97-bd0a-247cb5784bbb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:43.061058 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3fbb978-a649-4f97-bd0a-247cb5784bbb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:43.061866 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3fbb978-a649-4f97-bd0a-247cb5784bbb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:43.062809 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3fbb978-a649-4f97-bd0a-247cb5784bbb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:43.121206 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d3fbb978-a649-4f97-bd0a-247cb5784bbb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 14 microversion: 2.1 time: 0.073395 Jan 17 21:33:43.122808 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 623/1251] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:43 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:33:44.133808 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-33e63d31-55f0-4901-89b1-fc87f7db045e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:44.134808 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-33e63d31-55f0-4901-89b1-fc87f7db045e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:44.141657 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-33e63d31-55f0-4901-89b1-fc87f7db045e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:44.142114 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-33e63d31-55f0-4901-89b1-fc87f7db045e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:44.142901 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-33e63d31-55f0-4901-89b1-fc87f7db045e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:44.143347 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-33e63d31-55f0-4901-89b1-fc87f7db045e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:44.201045 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-33e63d31-55f0-4901-89b1-fc87f7db045e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 14 microversion: 2.1 time: 0.071120 Jan 17 21:33:44.201656 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 629/1252] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:44 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:33:45.213236 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-413b5342-1f0c-44ae-8e7e-94a76f6bf32b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:45.214233 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-413b5342-1f0c-44ae-8e7e-94a76f6bf32b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:45.221274 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-413b5342-1f0c-44ae-8e7e-94a76f6bf32b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:45.221731 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-413b5342-1f0c-44ae-8e7e-94a76f6bf32b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:45.222538 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-413b5342-1f0c-44ae-8e7e-94a76f6bf32b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:45.222981 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-413b5342-1f0c-44ae-8e7e-94a76f6bf32b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:45.283984 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-413b5342-1f0c-44ae-8e7e-94a76f6bf32b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 14 microversion: 2.1 time: 0.074583 Jan 17 21:33:45.287219 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 624/1253] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:45 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:33:45.783072 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-9aea021c-7bcc-4b35-902a-aae65a5b07ca tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:45.783724 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-9aea021c-7bcc-4b35-902a-aae65a5b07ca tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:45.785464 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-f112fdee-a73e-46ba-b498-95d88ed59959 req-1a40ee75-f956-4cbd-8064-1fe461c00832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b36124-78c9-4d6c-a106-743e642f28ea", "tag": "d25d6980-4925-4e8f-bed1-d6d5051f37ce"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:45.787006 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:33:45.787006 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:33:45.791376 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9aea021c-7bcc-4b35-902a-aae65a5b07ca tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:45.791842 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9aea021c-7bcc-4b35-902a-aae65a5b07ca tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:45.792667 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9aea021c-7bcc-4b35-902a-aae65a5b07ca tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:45.793300 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9aea021c-7bcc-4b35-902a-aae65a5b07ca tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:45.796057 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-f112fdee-a73e-46ba-b498-95d88ed59959 req-1a40ee75-f956-4cbd-8064-1fe461c00832 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:45.796527 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-f112fdee-a73e-46ba-b498-95d88ed59959 req-1a40ee75-f956-4cbd-8064-1fe461c00832 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:45.807829 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-f112fdee-a73e-46ba-b498-95d88ed59959 req-1a40ee75-f956-4cbd-8064-1fe461c00832 service nova] Creating event network-changed:d25d6980-4925-4e8f-bed1-d6d5051f37ce for instance a8b36124-78c9-4d6c-a106-743e642f28ea on hv-cinder-82489 Jan 17 21:33:45.812661 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-f112fdee-a73e-46ba-b498-95d88ed59959 req-1a40ee75-f956-4cbd-8064-1fe461c00832 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031706 Jan 17 21:33:45.813430 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 625/1254] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:33:45.818624 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-9aea021c-7bcc-4b35-902a-aae65a5b07ca tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Going to try to terminate instance {{(pid=116182) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:33:45.904795 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-9aea021c-7bcc-4b35-902a-aae65a5b07ca tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 204 len: 0 microversion: 2.1 time: 0.125946 Jan 17 21:33:45.905753 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 630/1255] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:33:45 2022] DELETE /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:33:45.915750 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ec3f6d5f-1df0-4dde-8a84-4f28ec6414b1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:45.916778 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ec3f6d5f-1df0-4dde-8a84-4f28ec6414b1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:45.923560 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec3f6d5f-1df0-4dde-8a84-4f28ec6414b1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:45.924260 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec3f6d5f-1df0-4dde-8a84-4f28ec6414b1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:45.925255 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec3f6d5f-1df0-4dde-8a84-4f28ec6414b1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:45.925857 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec3f6d5f-1df0-4dde-8a84-4f28ec6414b1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:46.078802 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ec3f6d5f-1df0-4dde-8a84-4f28ec6414b1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:46.087505 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ec3f6d5f-1df0-4dde-8a84-4f28ec6414b1 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1574 microversion: 2.1 time: 0.176489 Jan 17 21:33:46.088492 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 626/1256] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:45 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:46.295986 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-eff2ad45-ebd5-4da8-b902-cc689dccc1b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:46.297744 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-eff2ad45-ebd5-4da8-b902-cc689dccc1b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:46.304991 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eff2ad45-ebd5-4da8-b902-cc689dccc1b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:46.305453 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eff2ad45-ebd5-4da8-b902-cc689dccc1b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:46.306257 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eff2ad45-ebd5-4da8-b902-cc689dccc1b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:46.306733 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eff2ad45-ebd5-4da8-b902-cc689dccc1b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:46.373113 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-eff2ad45-ebd5-4da8-b902-cc689dccc1b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 14 microversion: 2.1 time: 0.081383 Jan 17 21:33:46.376994 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 631/1257] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:46 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:33:47.105151 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2e4fcbae-5f0d-4552-b02a-28f3e125a85c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:47.105766 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2e4fcbae-5f0d-4552-b02a-28f3e125a85c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:47.112696 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2e4fcbae-5f0d-4552-b02a-28f3e125a85c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:47.113152 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2e4fcbae-5f0d-4552-b02a-28f3e125a85c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:47.113943 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2e4fcbae-5f0d-4552-b02a-28f3e125a85c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:47.114386 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2e4fcbae-5f0d-4552-b02a-28f3e125a85c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:47.246372 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-2e4fcbae-5f0d-4552-b02a-28f3e125a85c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:47.253900 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2e4fcbae-5f0d-4552-b02a-28f3e125a85c tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1457 microversion: 2.1 time: 0.152384 Jan 17 21:33:47.254389 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 627/1258] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:47 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1457 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:47.384671 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ba89d393-a4ad-45c6-9265-4e01d5e11df1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:47.385672 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ba89d393-a4ad-45c6-9265-4e01d5e11df1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:47.393048 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ba89d393-a4ad-45c6-9265-4e01d5e11df1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:47.393507 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ba89d393-a4ad-45c6-9265-4e01d5e11df1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:47.394294 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ba89d393-a4ad-45c6-9265-4e01d5e11df1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:47.394739 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ba89d393-a4ad-45c6-9265-4e01d5e11df1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:47.508335 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ba89d393-a4ad-45c6-9265-4e01d5e11df1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 14 microversion: 2.1 time: 0.127505 Jan 17 21:33:47.508940 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 632/1259] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:47 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:33:48.271399 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-387e4efa-7f8c-4f66-85e8-3f06635fa7e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:48.272110 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-387e4efa-7f8c-4f66-85e8-3f06635fa7e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:48.279724 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-387e4efa-7f8c-4f66-85e8-3f06635fa7e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:48.280617 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-387e4efa-7f8c-4f66-85e8-3f06635fa7e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:48.282254 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-387e4efa-7f8c-4f66-85e8-3f06635fa7e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:48.282731 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-387e4efa-7f8c-4f66-85e8-3f06635fa7e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:48.307107 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-9a6e2854-8717-418f-a726-0d172f0b846e req-64995f3c-46dd-4490-8164-cb04715f1851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b36124-78c9-4d6c-a106-743e642f28ea", "name": "network-vif-deleted", "tag": "d25d6980-4925-4e8f-bed1-d6d5051f37ce"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:48.308252 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:33:48.308252 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:33:48.317129 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-9a6e2854-8717-418f-a726-0d172f0b846e req-64995f3c-46dd-4490-8164-cb04715f1851 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:48.317508 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-9a6e2854-8717-418f-a726-0d172f0b846e req-64995f3c-46dd-4490-8164-cb04715f1851 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:48.329738 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-9a6e2854-8717-418f-a726-0d172f0b846e req-64995f3c-46dd-4490-8164-cb04715f1851 service nova] Creating event network-vif-deleted:d25d6980-4925-4e8f-bed1-d6d5051f37ce for instance a8b36124-78c9-4d6c-a106-743e642f28ea on hv-cinder-82489 Jan 17 21:33:48.334889 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-9a6e2854-8717-418f-a726-0d172f0b846e req-64995f3c-46dd-4490-8164-cb04715f1851 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033135 Jan 17 21:33:48.335504 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 633/1260] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:33:48.357155 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-387e4efa-7f8c-4f66-85e8-3f06635fa7e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:48.366555 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-387e4efa-7f8c-4f66-85e8-3f06635fa7e3 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 200 len: 1390 microversion: 2.1 time: 0.097824 Jan 17 21:33:48.367187 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 628/1261] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:48 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:48.520668 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a59b29c4-a80e-4bd4-8a35-043368c6091c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:48.521740 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a59b29c4-a80e-4bd4-8a35-043368c6091c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:48.527867 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a59b29c4-a80e-4bd4-8a35-043368c6091c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:48.528312 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a59b29c4-a80e-4bd4-8a35-043368c6091c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:48.529115 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a59b29c4-a80e-4bd4-8a35-043368c6091c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:48.529549 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a59b29c4-a80e-4bd4-8a35-043368c6091c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:48.606900 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a59b29c4-a80e-4bd4-8a35-043368c6091c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 9491 microversion: 2.1 time: 0.091280 Jan 17 21:33:48.607554 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 634/1262] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:48 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 9491 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:49.525282 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3e23dfae-e164-4d63-8b9e-02f2cfe8d433 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:49.525990 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3e23dfae-e164-4d63-8b9e-02f2cfe8d433 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: a8b36124-78c9-4d6c-a106-743e642f28ea] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:49.532707 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3e23dfae-e164-4d63-8b9e-02f2cfe8d433 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:49.533182 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3e23dfae-e164-4d63-8b9e-02f2cfe8d433 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:49.533961 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3e23dfae-e164-4d63-8b9e-02f2cfe8d433 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:49.534398 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3e23dfae-e164-4d63-8b9e-02f2cfe8d433 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:49.549211 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-3e23dfae-e164-4d63-8b9e-02f2cfe8d433 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] HTTP exception thrown: Instance a8b36124-78c9-4d6c-a106-743e642f28ea could not be found. Jan 17 21:33:49.549788 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3e23dfae-e164-4d63-8b9e-02f2cfe8d433 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Returning 404 to user: Instance a8b36124-78c9-4d6c-a106-743e642f28ea could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:33:49.550597 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3e23dfae-e164-4d63-8b9e-02f2cfe8d433 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea" status: 404 len: 111 microversion: 2.1 time: 0.170455 Jan 17 21:33:49.551124 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 629/1263] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:49 2022] GET /compute/v2.1/servers/a8b36124-78c9-4d6c-a106-743e642f28ea => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:33:49.618785 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-64d8eb5f-0e53-42fa-9939-2a5f75a01b57 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:49.619827 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-64d8eb5f-0e53-42fa-9939-2a5f75a01b57 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:49.627940 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-64d8eb5f-0e53-42fa-9939-2a5f75a01b57 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:49.628426 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-64d8eb5f-0e53-42fa-9939-2a5f75a01b57 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:49.629232 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-64d8eb5f-0e53-42fa-9939-2a5f75a01b57 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:49.629679 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-64d8eb5f-0e53-42fa-9939-2a5f75a01b57 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:49.711023 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-64d8eb5f-0e53-42fa-9939-2a5f75a01b57 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 16280 microversion: 2.1 time: 0.096091 Jan 17 21:33:49.712025 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 635/1264] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:49 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 16280 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:33:50.722602 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a355268d-7102-45fa-8c71-9207634c0269 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:50.723597 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a355268d-7102-45fa-8c71-9207634c0269 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:50.730164 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a355268d-7102-45fa-8c71-9207634c0269 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:50.730985 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a355268d-7102-45fa-8c71-9207634c0269 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:50.731727 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a355268d-7102-45fa-8c71-9207634c0269 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:50.732168 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a355268d-7102-45fa-8c71-9207634c0269 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:50.803543 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a355268d-7102-45fa-8c71-9207634c0269 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 18561 microversion: 2.1 time: 0.084805 Jan 17 21:33:50.804161 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 630/1265] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:50 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 18561 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:33:51.815332 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-47df6f59-ca45-4c37-a9d8-5e43c1fe64ee tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:51.816498 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-47df6f59-ca45-4c37-a9d8-5e43c1fe64ee tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:51.823479 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-47df6f59-ca45-4c37-a9d8-5e43c1fe64ee tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:51.824024 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-47df6f59-ca45-4c37-a9d8-5e43c1fe64ee tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:51.824850 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-47df6f59-ca45-4c37-a9d8-5e43c1fe64ee tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:51.825300 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-47df6f59-ca45-4c37-a9d8-5e43c1fe64ee tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:51.897529 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-47df6f59-ca45-4c37-a9d8-5e43c1fe64ee tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 20593 microversion: 2.1 time: 0.086086 Jan 17 21:33:51.898607 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 636/1266] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:51 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 20593 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:33:52.607096 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-56c74da5-65a6-4de0-b056-04c546fb7069 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:52.607774 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-56c74da5-65a6-4de0-b056-04c546fb7069 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:52.613530 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-d6219fbb-28c7-4c76-8cdc-6274470f8f7a req-b604a19f-d7a4-40c6-bc82-dbdb4dd49a27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1b3ad9-6be9-4165-aea2-3a8bce7657b1", "tag": "49b3d1af-2602-4952-bb5a-f5c52e593c91"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:52.615103 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:33:52.615103 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:33:52.615516 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-56c74da5-65a6-4de0-b056-04c546fb7069 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:52.616280 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-56c74da5-65a6-4de0-b056-04c546fb7069 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:52.618962 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-56c74da5-65a6-4de0-b056-04c546fb7069 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:52.619603 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-56c74da5-65a6-4de0-b056-04c546fb7069 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:52.623708 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-d6219fbb-28c7-4c76-8cdc-6274470f8f7a req-b604a19f-d7a4-40c6-bc82-dbdb4dd49a27 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:52.624245 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-d6219fbb-28c7-4c76-8cdc-6274470f8f7a req-b604a19f-d7a4-40c6-bc82-dbdb4dd49a27 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:52.635848 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-d6219fbb-28c7-4c76-8cdc-6274470f8f7a req-b604a19f-d7a4-40c6-bc82-dbdb4dd49a27 service nova] Creating event network-changed:49b3d1af-2602-4952-bb5a-f5c52e593c91 for instance 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 on hv-cinder-82489 Jan 17 21:33:52.640965 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-d6219fbb-28c7-4c76-8cdc-6274470f8f7a req-b604a19f-d7a4-40c6-bc82-dbdb4dd49a27 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031734 Jan 17 21:33:52.641574 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 637/1267] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:33:52.650250 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-56c74da5-65a6-4de0-b056-04c546fb7069 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Going to try to terminate instance {{(pid=116183) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:33:52.735500 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-56c74da5-65a6-4de0-b056-04c546fb7069 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 204 len: 0 microversion: 2.1 time: 0.131978 Jan 17 21:33:52.736097 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 631/1268] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:33:52 2022] DELETE /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:33:52.745491 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-288aab6c-35e6-43d9-a94f-ef5c313560a0 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:52.746833 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-288aab6c-35e6-43d9-a94f-ef5c313560a0 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:52.753769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-288aab6c-35e6-43d9-a94f-ef5c313560a0 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:52.754230 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-288aab6c-35e6-43d9-a94f-ef5c313560a0 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:52.755200 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-288aab6c-35e6-43d9-a94f-ef5c313560a0 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:52.756406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-288aab6c-35e6-43d9-a94f-ef5c313560a0 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:52.909716 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d4b75599-e907-44eb-994d-23a9378379ce tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:52.910744 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d4b75599-e907-44eb-994d-23a9378379ce tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:52.910893 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-288aab6c-35e6-43d9-a94f-ef5c313560a0 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:52.918984 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-288aab6c-35e6-43d9-a94f-ef5c313560a0 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1576 microversion: 2.1 time: 0.178191 Jan 17 21:33:52.919233 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4b75599-e907-44eb-994d-23a9378379ce tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:52.919660 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4b75599-e907-44eb-994d-23a9378379ce tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:52.920689 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 638/1269] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:52 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:52.932365 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4b75599-e907-44eb-994d-23a9378379ce tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:52.933037 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4b75599-e907-44eb-994d-23a9378379ce tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:53.013038 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d4b75599-e907-44eb-994d-23a9378379ce tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 22785 microversion: 2.1 time: 0.108002 Jan 17 21:33:53.014131 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 632/1270] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:52 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 22785 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:33:53.937923 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-aa4517e0-7eb2-4328-ad6c-d6fad12c4ebe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:53.938671 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-aa4517e0-7eb2-4328-ad6c-d6fad12c4ebe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:53.944882 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-aa4517e0-7eb2-4328-ad6c-d6fad12c4ebe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:53.945328 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-aa4517e0-7eb2-4328-ad6c-d6fad12c4ebe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:53.946106 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-aa4517e0-7eb2-4328-ad6c-d6fad12c4ebe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:53.946574 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-aa4517e0-7eb2-4328-ad6c-d6fad12c4ebe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:54.025974 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2c8fe0f3-cf89-4c78-bd0b-1da3ffb1425b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:54.027002 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2c8fe0f3-cf89-4c78-bd0b-1da3ffb1425b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:54.034669 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c8fe0f3-cf89-4c78-bd0b-1da3ffb1425b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:54.035134 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c8fe0f3-cf89-4c78-bd0b-1da3ffb1425b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:54.035932 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c8fe0f3-cf89-4c78-bd0b-1da3ffb1425b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:54.036395 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2c8fe0f3-cf89-4c78-bd0b-1da3ffb1425b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:54.083213 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-aa4517e0-7eb2-4328-ad6c-d6fad12c4ebe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:54.090704 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-aa4517e0-7eb2-4328-ad6c-d6fad12c4ebe tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1458 microversion: 2.1 time: 0.156412 Jan 17 21:33:54.091384 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 639/1271] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:53 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1458 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:54.117513 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2c8fe0f3-cf89-4c78-bd0b-1da3ffb1425b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 23801 microversion: 2.1 time: 0.095456 Jan 17 21:33:54.118218 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 633/1272] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:54 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 23801 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:33:54.911700 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [req-1a9a5036-dd93-45d7-a83a-98178b3e7291 req-81fd4a1b-1fb4-4557-a348-8df052120677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1b3ad9-6be9-4165-aea2-3a8bce7657b1", "name": "network-vif-deleted", "tag": "49b3d1af-2602-4952-bb5a-f5c52e593c91"}]} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:54.913297 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:33:54.913297 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: warnings.warn(msg) Jan 17 21:33:54.921457 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-1a9a5036-dd93-45d7-a83a-98178b3e7291 req-81fd4a1b-1fb4-4557-a348-8df052120677 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:54.925050 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [req-1a9a5036-dd93-45d7-a83a-98178b3e7291 req-81fd4a1b-1fb4-4557-a348-8df052120677 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:54.934421 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.compute.server_external_events [req-1a9a5036-dd93-45d7-a83a-98178b3e7291 req-81fd4a1b-1fb4-4557-a348-8df052120677 service nova] Creating event network-vif-deleted:49b3d1af-2602-4952-bb5a-f5c52e593c91 for instance 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 on hv-cinder-82489 Jan 17 21:33:54.941717 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [req-1a9a5036-dd93-45d7-a83a-98178b3e7291 req-81fd4a1b-1fb4-4557-a348-8df052120677 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033472 Jan 17 21:33:54.942583 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 640/1273] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:33:55.111135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5b2d2965-54b0-4b00-9fe9-227eec6af568 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:55.111830 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5b2d2965-54b0-4b00-9fe9-227eec6af568 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:55.118604 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5b2d2965-54b0-4b00-9fe9-227eec6af568 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:55.119058 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5b2d2965-54b0-4b00-9fe9-227eec6af568 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:55.119847 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5b2d2965-54b0-4b00-9fe9-227eec6af568 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:55.120276 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5b2d2965-54b0-4b00-9fe9-227eec6af568 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:55.129741 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7253d409-00bb-4c5e-be24-ce872639499a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:55.130753 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7253d409-00bb-4c5e-be24-ce872639499a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:55.137202 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7253d409-00bb-4c5e-be24-ce872639499a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:55.137667 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7253d409-00bb-4c5e-be24-ce872639499a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:55.138489 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7253d409-00bb-4c5e-be24-ce872639499a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:55.138905 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7253d409-00bb-4c5e-be24-ce872639499a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:55.187174 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5b2d2965-54b0-4b00-9fe9-227eec6af568 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd489955c19471891724ec1badc11ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b00002d33945c6a8056483b241fbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:33:55.195481 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5b2d2965-54b0-4b00-9fe9-227eec6af568 tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 200 len: 1225 microversion: 2.1 time: 0.089201 Jan 17 21:33:55.196407 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 634/1274] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:55 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:33:55.228294 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7253d409-00bb-4c5e-be24-ce872639499a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 25036 microversion: 2.1 time: 0.102349 Jan 17 21:33:55.229290 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 641/1275] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:55 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 25036 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:33:56.212499 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4a80b0ab-4eb5-437e-99e9-11b59a5a08bc tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:56.213112 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4a80b0ab-4eb5-437e-99e9-11b59a5a08bc tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:56.219420 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a80b0ab-4eb5-437e-99e9-11b59a5a08bc tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:56.219873 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a80b0ab-4eb5-437e-99e9-11b59a5a08bc tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:56.220731 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a80b0ab-4eb5-437e-99e9-11b59a5a08bc tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:56.221174 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4a80b0ab-4eb5-437e-99e9-11b59a5a08bc tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:56.234041 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-4a80b0ab-4eb5-437e-99e9-11b59a5a08bc tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] HTTP exception thrown: Instance 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 could not be found. Jan 17 21:33:56.234680 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4a80b0ab-4eb5-437e-99e9-11b59a5a08bc tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Returning 404 to user: Instance 9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:33:56.235446 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4a80b0ab-4eb5-437e-99e9-11b59a5a08bc tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1" status: 404 len: 111 microversion: 2.1 time: 0.026714 Jan 17 21:33:56.236590 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 635/1276] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:56 2022] GET /compute/v2.1/servers/9f1b3ad9-6be9-4165-aea2-3a8bce7657b1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:33:56.240581 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-77cea623-d331-4fd3-857c-2e69d8d9fe1e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:56.241115 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-77cea623-d331-4fd3-857c-2e69d8d9fe1e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:56.248073 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77cea623-d331-4fd3-857c-2e69d8d9fe1e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:56.248561 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77cea623-d331-4fd3-857c-2e69d8d9fe1e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:56.249358 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77cea623-d331-4fd3-857c-2e69d8d9fe1e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:56.249796 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-77cea623-d331-4fd3-857c-2e69d8d9fe1e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:56.323272 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-77cea623-d331-4fd3-857c-2e69d8d9fe1e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 26519 microversion: 2.1 time: 0.087515 Jan 17 21:33:56.323962 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 642/1277] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:56 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 26519 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:33:56.691094 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-41ff2acd-6dea-450e-9a70-1e1524fc9beb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:56.691611 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-41ff2acd-6dea-450e-9a70-1e1524fc9beb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:56.698094 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-41ff2acd-6dea-450e-9a70-1e1524fc9beb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:56.698549 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-41ff2acd-6dea-450e-9a70-1e1524fc9beb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:56.699334 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-41ff2acd-6dea-450e-9a70-1e1524fc9beb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:56.699775 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-41ff2acd-6dea-450e-9a70-1e1524fc9beb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:56.715089 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-41ff2acd-6dea-450e-9a70-1e1524fc9beb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] HTTP exception thrown: Instance 851b3dd1-961b-4d23-9594-2a55d4f0f703 could not be found. Jan 17 21:33:56.715665 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-41ff2acd-6dea-450e-9a70-1e1524fc9beb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Returning 404 to user: Instance 851b3dd1-961b-4d23-9594-2a55d4f0f703 could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:33:56.716506 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-41ff2acd-6dea-450e-9a70-1e1524fc9beb tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "DELETE /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 404 len: 111 microversion: 2.1 time: 0.029136 Jan 17 21:33:56.717029 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 636/1278] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:33:56 2022] DELETE /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:33:56.726153 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d4e48964-dbe0-4274-9fbb-964619795cee tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:56.726852 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d4e48964-dbe0-4274-9fbb-964619795cee tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] [instance: 851b3dd1-961b-4d23-9594-2a55d4f0f703] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:56.733894 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d4e48964-dbe0-4274-9fbb-964619795cee tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:56.734354 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d4e48964-dbe0-4274-9fbb-964619795cee tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:56.735145 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d4e48964-dbe0-4274-9fbb-964619795cee tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:56.735597 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d4e48964-dbe0-4274-9fbb-964619795cee tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:56.750305 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-d4e48964-dbe0-4274-9fbb-964619795cee tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] HTTP exception thrown: Instance 851b3dd1-961b-4d23-9594-2a55d4f0f703 could not be found. Jan 17 21:33:56.750857 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d4e48964-dbe0-4274-9fbb-964619795cee tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Returning 404 to user: Instance 851b3dd1-961b-4d23-9594-2a55d4f0f703 could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:33:56.751788 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d4e48964-dbe0-4274-9fbb-964619795cee tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703" status: 404 len: 111 microversion: 2.1 time: 0.029836 Jan 17 21:33:56.752323 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 643/1279] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:33:56 2022] GET /compute/v2.1/servers/851b3dd1-961b-4d23-9594-2a55d4f0f703 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 17 21:33:57.335815 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-50f2636e-7d2c-4f5a-970b-8a77dc77baf4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:57.336817 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-50f2636e-7d2c-4f5a-970b-8a77dc77baf4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:57.342796 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-50f2636e-7d2c-4f5a-970b-8a77dc77baf4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:57.343261 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-50f2636e-7d2c-4f5a-970b-8a77dc77baf4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:57.344054 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-50f2636e-7d2c-4f5a-970b-8a77dc77baf4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:57.344529 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-50f2636e-7d2c-4f5a-970b-8a77dc77baf4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:57.420080 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-50f2636e-7d2c-4f5a-970b-8a77dc77baf4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 27637 microversion: 2.1 time: 0.088419 Jan 17 21:33:57.420796 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 637/1280] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:57 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 27637 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:33:58.030240 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-54494eac-0058-4ff5-8a03-03ff157de0ef tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] Calling method '.version_select at 0x7f89769a3e50>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:33:58.050408 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-54494eac-0058-4ff5-8a03-03ff157de0ef tempest-TestVolumeBootPattern-1281129135 tempest-TestVolumeBootPattern-1281129135-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-577368355" status: 202 len: 0 microversion: 2.1 time: 0.023797 Jan 17 21:33:58.051093 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 644/1281] 10.222.0.64 () {58 vars in 1259 bytes} [Mon Jan 17 21:33:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-577368355 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:33:58.431395 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-422788fa-be86-4c02-9470-a451b247f3a1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:58.432513 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-422788fa-be86-4c02-9470-a451b247f3a1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:58.439300 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-422788fa-be86-4c02-9470-a451b247f3a1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:58.439759 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-422788fa-be86-4c02-9470-a451b247f3a1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:58.440586 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-422788fa-be86-4c02-9470-a451b247f3a1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:58.441025 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-422788fa-be86-4c02-9470-a451b247f3a1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:58.513486 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-422788fa-be86-4c02-9470-a451b247f3a1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 27924 microversion: 2.1 time: 0.085897 Jan 17 21:33:58.517882 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 638/1282] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:58 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 27924 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:33:59.525571 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b4cc0dfe-ada2-4144-9c7e-5f9de37b1c78 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:33:59.526754 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b4cc0dfe-ada2-4144-9c7e-5f9de37b1c78 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:33:59.534179 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b4cc0dfe-ada2-4144-9c7e-5f9de37b1c78 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:59.534712 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b4cc0dfe-ada2-4144-9c7e-5f9de37b1c78 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:59.535570 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b4cc0dfe-ada2-4144-9c7e-5f9de37b1c78 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:33:59.536115 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b4cc0dfe-ada2-4144-9c7e-5f9de37b1c78 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:33:59.620392 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b4cc0dfe-ada2-4144-9c7e-5f9de37b1c78 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28220 microversion: 2.1 time: 0.098757 Jan 17 21:33:59.621765 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 645/1283] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:33:59 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:00.636982 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5b6b29f2-69bb-477f-a255-dbbb2cf5b1bf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:00.638578 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5b6b29f2-69bb-477f-a255-dbbb2cf5b1bf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:00.647086 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5b6b29f2-69bb-477f-a255-dbbb2cf5b1bf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:00.647653 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5b6b29f2-69bb-477f-a255-dbbb2cf5b1bf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:00.648474 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5b6b29f2-69bb-477f-a255-dbbb2cf5b1bf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:00.649142 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5b6b29f2-69bb-477f-a255-dbbb2cf5b1bf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:00.732443 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5b6b29f2-69bb-477f-a255-dbbb2cf5b1bf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28220 microversion: 2.1 time: 0.101496 Jan 17 21:34:00.733073 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 639/1284] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:00 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:34:01.746983 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-c59e889d-10da-4748-a5bc-99e94abf6f7e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:01.748235 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-c59e889d-10da-4748-a5bc-99e94abf6f7e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:01.755850 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c59e889d-10da-4748-a5bc-99e94abf6f7e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:01.756307 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c59e889d-10da-4748-a5bc-99e94abf6f7e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:01.757125 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c59e889d-10da-4748-a5bc-99e94abf6f7e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:01.757565 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-c59e889d-10da-4748-a5bc-99e94abf6f7e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:01.815121 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-c59e889d-10da-4748-a5bc-99e94abf6f7e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28220 microversion: 2.1 time: 0.072897 Jan 17 21:34:01.819354 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 646/1285] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:01 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28220 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:02.827877 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6faddc5d-4310-4b4f-881e-fc23d03d3ca7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:02.828910 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6faddc5d-4310-4b4f-881e-fc23d03d3ca7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:02.836217 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6faddc5d-4310-4b4f-881e-fc23d03d3ca7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:02.836761 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6faddc5d-4310-4b4f-881e-fc23d03d3ca7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:02.837622 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6faddc5d-4310-4b4f-881e-fc23d03d3ca7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:02.838129 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6faddc5d-4310-4b4f-881e-fc23d03d3ca7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:02.898518 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6faddc5d-4310-4b4f-881e-fc23d03d3ca7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28220 microversion: 2.1 time: 0.074674 Jan 17 21:34:02.899192 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 640/1286] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:02 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28220 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:03.910480 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8f04de60-86e4-4528-8ff8-e6d4241f9b26 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:03.911599 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8f04de60-86e4-4528-8ff8-e6d4241f9b26 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:03.918722 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8f04de60-86e4-4528-8ff8-e6d4241f9b26 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:03.919158 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8f04de60-86e4-4528-8ff8-e6d4241f9b26 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:03.920032 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8f04de60-86e4-4528-8ff8-e6d4241f9b26 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:03.920590 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8f04de60-86e4-4528-8ff8-e6d4241f9b26 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:03.982515 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8f04de60-86e4-4528-8ff8-e6d4241f9b26 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28220 microversion: 2.1 time: 0.075895 Jan 17 21:34:03.983720 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 647/1287] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:03 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28220 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:04.995171 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8b1cf72f-b262-41a2-a84f-7618af64c82d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:04.996257 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8b1cf72f-b262-41a2-a84f-7618af64c82d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:05.003870 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8b1cf72f-b262-41a2-a84f-7618af64c82d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:05.004325 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8b1cf72f-b262-41a2-a84f-7618af64c82d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:05.005166 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8b1cf72f-b262-41a2-a84f-7618af64c82d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:05.005603 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8b1cf72f-b262-41a2-a84f-7618af64c82d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:05.070610 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8b1cf72f-b262-41a2-a84f-7618af64c82d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28220 microversion: 2.1 time: 0.079124 Jan 17 21:34:05.071446 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 641/1288] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:04 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:06.083298 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-35b0842a-0e7d-4114-af63-d69133a6f56b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:06.084304 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-35b0842a-0e7d-4114-af63-d69133a6f56b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:06.092032 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35b0842a-0e7d-4114-af63-d69133a6f56b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:06.092780 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35b0842a-0e7d-4114-af63-d69133a6f56b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:06.093985 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35b0842a-0e7d-4114-af63-d69133a6f56b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:06.094594 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35b0842a-0e7d-4114-af63-d69133a6f56b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:06.156697 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-35b0842a-0e7d-4114-af63-d69133a6f56b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28220 microversion: 2.1 time: 0.077442 Jan 17 21:34:06.157601 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 648/1289] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:06 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:07.169311 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c43395f3-5418-4924-bd22-763b1e450989 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:07.170319 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c43395f3-5418-4924-bd22-763b1e450989 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:07.177320 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c43395f3-5418-4924-bd22-763b1e450989 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:07.177782 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c43395f3-5418-4924-bd22-763b1e450989 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:07.178697 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c43395f3-5418-4924-bd22-763b1e450989 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:07.179141 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c43395f3-5418-4924-bd22-763b1e450989 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:07.240519 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c43395f3-5418-4924-bd22-763b1e450989 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28220 microversion: 2.1 time: 0.075100 Jan 17 21:34:07.241077 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 642/1290] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:07 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28220 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:08.253306 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fbe1b53f-b4cc-48a6-a16a-e8c5c4676a73 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:08.254231 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fbe1b53f-b4cc-48a6-a16a-e8c5c4676a73 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:08.261192 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fbe1b53f-b4cc-48a6-a16a-e8c5c4676a73 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:08.261652 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fbe1b53f-b4cc-48a6-a16a-e8c5c4676a73 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:08.262449 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fbe1b53f-b4cc-48a6-a16a-e8c5c4676a73 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:08.262892 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fbe1b53f-b4cc-48a6-a16a-e8c5c4676a73 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:08.326659 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fbe1b53f-b4cc-48a6-a16a-e8c5c4676a73 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28220 microversion: 2.1 time: 0.077302 Jan 17 21:34:08.327383 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 649/1291] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:08 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:09.344265 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-64b546ea-1f04-45ce-944c-616600263428 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:09.346547 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-64b546ea-1f04-45ce-944c-616600263428 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:09.357233 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-64b546ea-1f04-45ce-944c-616600263428 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:09.357832 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-64b546ea-1f04-45ce-944c-616600263428 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:09.358956 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-64b546ea-1f04-45ce-944c-616600263428 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:09.359399 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-64b546ea-1f04-45ce-944c-616600263428 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:09.436309 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-64b546ea-1f04-45ce-944c-616600263428 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28220 microversion: 2.1 time: 0.099661 Jan 17 21:34:09.437029 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 643/1292] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:09 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:34:10.449032 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-db4d6c2e-3d70-4f3d-90c0-045822f838e9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:10.450062 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-db4d6c2e-3d70-4f3d-90c0-045822f838e9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:10.457140 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-db4d6c2e-3d70-4f3d-90c0-045822f838e9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:10.457856 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-db4d6c2e-3d70-4f3d-90c0-045822f838e9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:10.458643 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-db4d6c2e-3d70-4f3d-90c0-045822f838e9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:10.459075 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-db4d6c2e-3d70-4f3d-90c0-045822f838e9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:10.526941 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-db4d6c2e-3d70-4f3d-90c0-045822f838e9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28220 microversion: 2.1 time: 0.082145 Jan 17 21:34:10.527600 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 650/1293] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:10 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:11.539791 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1775a73d-134e-4250-8e69-eab6f996f5a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:11.540807 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1775a73d-134e-4250-8e69-eab6f996f5a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:11.547579 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1775a73d-134e-4250-8e69-eab6f996f5a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:11.548030 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1775a73d-134e-4250-8e69-eab6f996f5a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:11.548833 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1775a73d-134e-4250-8e69-eab6f996f5a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:11.550160 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1775a73d-134e-4250-8e69-eab6f996f5a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:11.614372 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1775a73d-134e-4250-8e69-eab6f996f5a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28220 microversion: 2.1 time: 0.078360 Jan 17 21:34:11.615914 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 644/1294] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:11 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:12.626718 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-01274739-c116-446c-896d-4c700cad85f4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:12.629312 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-01274739-c116-446c-896d-4c700cad85f4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:12.636281 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-01274739-c116-446c-896d-4c700cad85f4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:12.636767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-01274739-c116-446c-896d-4c700cad85f4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:12.637566 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-01274739-c116-446c-896d-4c700cad85f4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:12.638015 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-01274739-c116-446c-896d-4c700cad85f4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:12.719270 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-01274739-c116-446c-896d-4c700cad85f4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28511 microversion: 2.1 time: 0.096440 Jan 17 21:34:12.720178 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 651/1295] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:12 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28511 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:13.731051 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ce2cd0bc-a651-467b-8621-93d560659327 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:13.732088 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ce2cd0bc-a651-467b-8621-93d560659327 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:13.739084 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ce2cd0bc-a651-467b-8621-93d560659327 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:13.739540 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ce2cd0bc-a651-467b-8621-93d560659327 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:13.740336 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ce2cd0bc-a651-467b-8621-93d560659327 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:13.740807 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ce2cd0bc-a651-467b-8621-93d560659327 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:13.808264 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ce2cd0bc-a651-467b-8621-93d560659327 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28511 microversion: 2.1 time: 0.081047 Jan 17 21:34:13.808969 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 645/1296] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:13 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28511 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:14.820525 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ceea3055-cc2d-4556-878a-384fb389a2b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:14.821432 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ceea3055-cc2d-4556-878a-384fb389a2b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:14.828331 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ceea3055-cc2d-4556-878a-384fb389a2b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:14.828810 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ceea3055-cc2d-4556-878a-384fb389a2b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:14.829584 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ceea3055-cc2d-4556-878a-384fb389a2b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:14.830019 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ceea3055-cc2d-4556-878a-384fb389a2b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:14.902957 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ceea3055-cc2d-4556-878a-384fb389a2b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.086422 Jan 17 21:34:14.903599 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 652/1297] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:14 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:15.915667 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-e6c1ac27-4a8b-4a78-a3fe-0a61476d8b99 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:15.916718 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-e6c1ac27-4a8b-4a78-a3fe-0a61476d8b99 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:15.923582 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e6c1ac27-4a8b-4a78-a3fe-0a61476d8b99 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:15.924030 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e6c1ac27-4a8b-4a78-a3fe-0a61476d8b99 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:15.924846 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e6c1ac27-4a8b-4a78-a3fe-0a61476d8b99 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:15.925288 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-e6c1ac27-4a8b-4a78-a3fe-0a61476d8b99 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:15.983603 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-e6c1ac27-4a8b-4a78-a3fe-0a61476d8b99 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.071748 Jan 17 21:34:15.984270 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 646/1298] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:15 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:16.995643 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-33208331-7856-4834-bc33-72d77cccae39 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:16.996736 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-33208331-7856-4834-bc33-72d77cccae39 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:17.003611 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-33208331-7856-4834-bc33-72d77cccae39 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:17.004071 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-33208331-7856-4834-bc33-72d77cccae39 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:17.004894 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-33208331-7856-4834-bc33-72d77cccae39 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:17.005337 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-33208331-7856-4834-bc33-72d77cccae39 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:17.064226 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-33208331-7856-4834-bc33-72d77cccae39 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.072442 Jan 17 21:34:17.064900 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 653/1299] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:16 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:18.076497 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-cc54744d-8adb-4a76-846c-fb024320d008 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:18.077504 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-cc54744d-8adb-4a76-846c-fb024320d008 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:18.084978 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cc54744d-8adb-4a76-846c-fb024320d008 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:18.085436 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cc54744d-8adb-4a76-846c-fb024320d008 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:18.086230 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cc54744d-8adb-4a76-846c-fb024320d008 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:18.086671 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cc54744d-8adb-4a76-846c-fb024320d008 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:18.150891 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-cc54744d-8adb-4a76-846c-fb024320d008 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.078260 Jan 17 21:34:18.151794 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 647/1300] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:18 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:19.163167 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8d80a016-2d5c-4754-a144-11863f783e60 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:19.164223 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8d80a016-2d5c-4754-a144-11863f783e60 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:19.171183 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8d80a016-2d5c-4754-a144-11863f783e60 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:19.171641 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8d80a016-2d5c-4754-a144-11863f783e60 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:19.172501 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8d80a016-2d5c-4754-a144-11863f783e60 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:19.172947 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8d80a016-2d5c-4754-a144-11863f783e60 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:19.232185 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8d80a016-2d5c-4754-a144-11863f783e60 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.072886 Jan 17 21:34:19.232864 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 654/1301] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:19 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:20.244637 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d3183b57-5db7-41d6-98c9-6dd171e69178 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:20.245587 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d3183b57-5db7-41d6-98c9-6dd171e69178 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:20.252560 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3183b57-5db7-41d6-98c9-6dd171e69178 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:20.253020 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3183b57-5db7-41d6-98c9-6dd171e69178 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:20.253820 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3183b57-5db7-41d6-98c9-6dd171e69178 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:20.254265 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d3183b57-5db7-41d6-98c9-6dd171e69178 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:20.320701 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d3183b57-5db7-41d6-98c9-6dd171e69178 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.079953 Jan 17 21:34:20.321345 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 648/1302] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:20 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:21.333806 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3cae145f-01a2-43a6-8047-76199bd1fa04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:21.334732 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-3cae145f-01a2-43a6-8047-76199bd1fa04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:21.341836 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3cae145f-01a2-43a6-8047-76199bd1fa04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:21.342285 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3cae145f-01a2-43a6-8047-76199bd1fa04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:21.343072 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3cae145f-01a2-43a6-8047-76199bd1fa04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:21.343510 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3cae145f-01a2-43a6-8047-76199bd1fa04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:21.412746 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3cae145f-01a2-43a6-8047-76199bd1fa04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.083415 Jan 17 21:34:21.413416 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 655/1303] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:21 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:22.424504 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a9c5e7e2-5e65-4673-8f12-5089edce669c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:22.426040 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a9c5e7e2-5e65-4673-8f12-5089edce669c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:22.432998 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a9c5e7e2-5e65-4673-8f12-5089edce669c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:22.433452 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a9c5e7e2-5e65-4673-8f12-5089edce669c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:22.434311 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a9c5e7e2-5e65-4673-8f12-5089edce669c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:22.434665 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a9c5e7e2-5e65-4673-8f12-5089edce669c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:22.501316 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a9c5e7e2-5e65-4673-8f12-5089edce669c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.080739 Jan 17 21:34:22.502267 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 649/1304] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:22 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:23.513144 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-25d3b603-bd99-4e03-a628-70f299b8ad04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:23.514126 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-25d3b603-bd99-4e03-a628-70f299b8ad04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:23.521541 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-25d3b603-bd99-4e03-a628-70f299b8ad04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:23.521990 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-25d3b603-bd99-4e03-a628-70f299b8ad04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:23.522769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-25d3b603-bd99-4e03-a628-70f299b8ad04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:23.523206 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-25d3b603-bd99-4e03-a628-70f299b8ad04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:23.581332 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-25d3b603-bd99-4e03-a628-70f299b8ad04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.071951 Jan 17 21:34:23.582830 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 656/1305] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:23 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:24.594366 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2eaa2e6a-ca10-4e20-bf97-7269cdce9893 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:24.595364 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2eaa2e6a-ca10-4e20-bf97-7269cdce9893 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:24.602904 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2eaa2e6a-ca10-4e20-bf97-7269cdce9893 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:24.603355 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2eaa2e6a-ca10-4e20-bf97-7269cdce9893 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:24.604138 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2eaa2e6a-ca10-4e20-bf97-7269cdce9893 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:24.604616 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2eaa2e6a-ca10-4e20-bf97-7269cdce9893 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:24.662594 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2eaa2e6a-ca10-4e20-bf97-7269cdce9893 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.072176 Jan 17 21:34:24.663240 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 650/1306] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:24 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:25.674774 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1acf6dfc-23a1-46f3-b8e9-5a2ce57e2d5d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:25.676386 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1acf6dfc-23a1-46f3-b8e9-5a2ce57e2d5d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:25.683896 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1acf6dfc-23a1-46f3-b8e9-5a2ce57e2d5d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:25.684347 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1acf6dfc-23a1-46f3-b8e9-5a2ce57e2d5d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:25.685173 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1acf6dfc-23a1-46f3-b8e9-5a2ce57e2d5d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:25.685615 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1acf6dfc-23a1-46f3-b8e9-5a2ce57e2d5d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:25.746066 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1acf6dfc-23a1-46f3-b8e9-5a2ce57e2d5d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.075116 Jan 17 21:34:25.746743 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 657/1307] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:25 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:26.758525 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-98333722-9a57-4c4c-9c31-3521fab49244 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:26.759468 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-98333722-9a57-4c4c-9c31-3521fab49244 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:26.766770 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-98333722-9a57-4c4c-9c31-3521fab49244 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:26.767233 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-98333722-9a57-4c4c-9c31-3521fab49244 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:26.768047 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-98333722-9a57-4c4c-9c31-3521fab49244 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:26.768518 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-98333722-9a57-4c4c-9c31-3521fab49244 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:26.829268 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-98333722-9a57-4c4c-9c31-3521fab49244 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.074775 Jan 17 21:34:26.830214 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 651/1308] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:26 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:27.842185 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ed746b2b-8a00-408d-bb83-1467fad28078 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:27.843197 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ed746b2b-8a00-408d-bb83-1467fad28078 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:27.850402 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ed746b2b-8a00-408d-bb83-1467fad28078 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:27.850832 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ed746b2b-8a00-408d-bb83-1467fad28078 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:27.851662 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ed746b2b-8a00-408d-bb83-1467fad28078 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:27.852099 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ed746b2b-8a00-408d-bb83-1467fad28078 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:27.913545 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ed746b2b-8a00-408d-bb83-1467fad28078 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.075198 Jan 17 21:34:27.914208 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 658/1309] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:27 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:28.926581 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-287a0ad4-8502-43c2-b598-eae0cfa92113 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:28.927592 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-287a0ad4-8502-43c2-b598-eae0cfa92113 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:28.934846 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-287a0ad4-8502-43c2-b598-eae0cfa92113 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:28.935295 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-287a0ad4-8502-43c2-b598-eae0cfa92113 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:28.936093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-287a0ad4-8502-43c2-b598-eae0cfa92113 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:28.936561 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-287a0ad4-8502-43c2-b598-eae0cfa92113 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:29.003997 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-287a0ad4-8502-43c2-b598-eae0cfa92113 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.081435 Jan 17 21:34:29.005314 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 652/1310] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:28 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:30.016689 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-9a21eece-cd17-4574-a1d0-d9e50e625929 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:30.017697 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-9a21eece-cd17-4574-a1d0-d9e50e625929 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:30.025209 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9a21eece-cd17-4574-a1d0-d9e50e625929 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:30.025656 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9a21eece-cd17-4574-a1d0-d9e50e625929 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:30.026440 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9a21eece-cd17-4574-a1d0-d9e50e625929 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:30.026877 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9a21eece-cd17-4574-a1d0-d9e50e625929 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:30.102437 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-9a21eece-cd17-4574-a1d0-d9e50e625929 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.088964 Jan 17 21:34:30.104068 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 659/1311] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:30 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:31.115722 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-de632b8b-4ab6-4a5d-a034-92771dd07be2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:31.116790 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-de632b8b-4ab6-4a5d-a034-92771dd07be2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:31.124261 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-de632b8b-4ab6-4a5d-a034-92771dd07be2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:31.124762 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-de632b8b-4ab6-4a5d-a034-92771dd07be2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:31.125696 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-de632b8b-4ab6-4a5d-a034-92771dd07be2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:31.126303 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-de632b8b-4ab6-4a5d-a034-92771dd07be2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:31.201710 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-de632b8b-4ab6-4a5d-a034-92771dd07be2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.089958 Jan 17 21:34:31.202365 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 653/1312] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:31 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:32.215701 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-83e468d4-a35c-48b5-85ee-df8ffe285a72 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:32.216721 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-83e468d4-a35c-48b5-85ee-df8ffe285a72 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:32.224315 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-83e468d4-a35c-48b5-85ee-df8ffe285a72 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:32.224793 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-83e468d4-a35c-48b5-85ee-df8ffe285a72 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:32.225587 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-83e468d4-a35c-48b5-85ee-df8ffe285a72 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:32.226023 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-83e468d4-a35c-48b5-85ee-df8ffe285a72 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:32.287080 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-83e468d4-a35c-48b5-85ee-df8ffe285a72 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.075126 Jan 17 21:34:32.287641 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 660/1313] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:32 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:33.299639 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d4d2d19e-3f1d-4fc2-9459-ebaf3de58ee2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:33.301271 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d4d2d19e-3f1d-4fc2-9459-ebaf3de58ee2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:33.308202 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4d2d19e-3f1d-4fc2-9459-ebaf3de58ee2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:33.308691 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4d2d19e-3f1d-4fc2-9459-ebaf3de58ee2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:33.309507 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4d2d19e-3f1d-4fc2-9459-ebaf3de58ee2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:33.309937 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4d2d19e-3f1d-4fc2-9459-ebaf3de58ee2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:33.368978 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d4d2d19e-3f1d-4fc2-9459-ebaf3de58ee2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.073429 Jan 17 21:34:33.369674 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 654/1314] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:33 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:34.382052 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e0dd29be-156f-405a-bca1-6898d3b5577b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:34.383069 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e0dd29be-156f-405a-bca1-6898d3b5577b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:34.390107 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e0dd29be-156f-405a-bca1-6898d3b5577b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:34.390559 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e0dd29be-156f-405a-bca1-6898d3b5577b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:34.391358 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e0dd29be-156f-405a-bca1-6898d3b5577b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:34.391790 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e0dd29be-156f-405a-bca1-6898d3b5577b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:34.454876 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e0dd29be-156f-405a-bca1-6898d3b5577b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.077181 Jan 17 21:34:34.455549 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 661/1315] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:34 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:35.467683 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-24bca087-6e29-49c1-b582-4133fb7b6a93 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:35.468773 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-24bca087-6e29-49c1-b582-4133fb7b6a93 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:35.476746 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24bca087-6e29-49c1-b582-4133fb7b6a93 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:35.477195 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24bca087-6e29-49c1-b582-4133fb7b6a93 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:35.478054 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24bca087-6e29-49c1-b582-4133fb7b6a93 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:35.478492 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-24bca087-6e29-49c1-b582-4133fb7b6a93 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:35.554784 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-24bca087-6e29-49c1-b582-4133fb7b6a93 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.090989 Jan 17 21:34:35.555490 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 655/1316] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:35 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:36.566835 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-169bf84d-9f69-448f-814d-07daa8045d77 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:36.567854 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-169bf84d-9f69-448f-814d-07daa8045d77 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:36.575232 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-169bf84d-9f69-448f-814d-07daa8045d77 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:36.575689 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-169bf84d-9f69-448f-814d-07daa8045d77 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:36.576529 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-169bf84d-9f69-448f-814d-07daa8045d77 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:36.576976 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-169bf84d-9f69-448f-814d-07daa8045d77 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:36.647493 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-169bf84d-9f69-448f-814d-07daa8045d77 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.084674 Jan 17 21:34:36.648152 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 662/1317] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:36 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:37.661147 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-94fbbfaf-c127-48dc-92b9-756abf412133 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:37.662409 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-94fbbfaf-c127-48dc-92b9-756abf412133 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:37.670713 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94fbbfaf-c127-48dc-92b9-756abf412133 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:37.671178 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94fbbfaf-c127-48dc-92b9-756abf412133 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:37.673792 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94fbbfaf-c127-48dc-92b9-756abf412133 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:37.674240 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-94fbbfaf-c127-48dc-92b9-756abf412133 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:37.751350 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-94fbbfaf-c127-48dc-92b9-756abf412133 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.094783 Jan 17 21:34:37.752020 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 656/1318] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:37 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:38.763776 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-70a5d0f3-5b57-45a9-a8d9-23cbe081bc70 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:38.764720 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-70a5d0f3-5b57-45a9-a8d9-23cbe081bc70 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:38.773028 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-70a5d0f3-5b57-45a9-a8d9-23cbe081bc70 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:38.773491 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-70a5d0f3-5b57-45a9-a8d9-23cbe081bc70 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:38.774311 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-70a5d0f3-5b57-45a9-a8d9-23cbe081bc70 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:38.774759 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-70a5d0f3-5b57-45a9-a8d9-23cbe081bc70 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:38.842392 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-70a5d0f3-5b57-45a9-a8d9-23cbe081bc70 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.082609 Jan 17 21:34:38.843052 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 663/1319] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:38 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:39.854664 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c5c2f6d5-43c3-4c38-bc47-35f666ecf65d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:39.855671 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c5c2f6d5-43c3-4c38-bc47-35f666ecf65d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:39.863385 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c5c2f6d5-43c3-4c38-bc47-35f666ecf65d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:39.863799 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c5c2f6d5-43c3-4c38-bc47-35f666ecf65d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:39.864628 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c5c2f6d5-43c3-4c38-bc47-35f666ecf65d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:39.865072 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c5c2f6d5-43c3-4c38-bc47-35f666ecf65d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:39.926601 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c5c2f6d5-43c3-4c38-bc47-35f666ecf65d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.075794 Jan 17 21:34:39.927557 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 657/1320] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:39 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:40.938890 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0c2e85ac-55ae-4617-9fb2-cd643d14d0f6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:40.939892 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0c2e85ac-55ae-4617-9fb2-cd643d14d0f6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:40.947470 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0c2e85ac-55ae-4617-9fb2-cd643d14d0f6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:40.947935 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0c2e85ac-55ae-4617-9fb2-cd643d14d0f6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:40.948754 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0c2e85ac-55ae-4617-9fb2-cd643d14d0f6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:40.949197 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0c2e85ac-55ae-4617-9fb2-cd643d14d0f6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:41.010330 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0c2e85ac-55ae-4617-9fb2-cd643d14d0f6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.075260 Jan 17 21:34:41.011027 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 664/1321] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:40 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:42.022793 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-83475b8d-ae95-4399-aea5-03a5af336d2f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:42.023799 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-83475b8d-ae95-4399-aea5-03a5af336d2f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:42.030933 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83475b8d-ae95-4399-aea5-03a5af336d2f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:42.031389 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83475b8d-ae95-4399-aea5-03a5af336d2f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:42.032229 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83475b8d-ae95-4399-aea5-03a5af336d2f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:42.032705 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-83475b8d-ae95-4399-aea5-03a5af336d2f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:42.091851 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-83475b8d-ae95-4399-aea5-03a5af336d2f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.072968 Jan 17 21:34:42.092575 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 658/1322] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:42 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:43.104210 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a0b44fc0-df3d-4a40-9bf9-53709d5efeaf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:43.105280 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a0b44fc0-df3d-4a40-9bf9-53709d5efeaf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:43.112931 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a0b44fc0-df3d-4a40-9bf9-53709d5efeaf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:43.113392 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a0b44fc0-df3d-4a40-9bf9-53709d5efeaf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:43.114187 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a0b44fc0-df3d-4a40-9bf9-53709d5efeaf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:43.114627 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a0b44fc0-df3d-4a40-9bf9-53709d5efeaf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:43.173814 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a0b44fc0-df3d-4a40-9bf9-53709d5efeaf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.073502 Jan 17 21:34:43.174495 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 665/1323] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:43 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:44.185998 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4b886591-773b-4ab4-b75a-d8e21579c2ac tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:44.186990 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4b886591-773b-4ab4-b75a-d8e21579c2ac tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:44.194566 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4b886591-773b-4ab4-b75a-d8e21579c2ac tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:44.195019 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4b886591-773b-4ab4-b75a-d8e21579c2ac tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:44.195803 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4b886591-773b-4ab4-b75a-d8e21579c2ac tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:44.196240 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4b886591-773b-4ab4-b75a-d8e21579c2ac tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:44.255721 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4b886591-773b-4ab4-b75a-d8e21579c2ac tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.073475 Jan 17 21:34:44.256295 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 659/1324] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:44 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:34:45.267919 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-88bb49c6-eb5e-4fb2-a1d1-7e1f8800a17b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:45.269468 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-88bb49c6-eb5e-4fb2-a1d1-7e1f8800a17b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:45.276623 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-88bb49c6-eb5e-4fb2-a1d1-7e1f8800a17b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:45.277088 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-88bb49c6-eb5e-4fb2-a1d1-7e1f8800a17b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:45.277888 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-88bb49c6-eb5e-4fb2-a1d1-7e1f8800a17b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:45.278333 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-88bb49c6-eb5e-4fb2-a1d1-7e1f8800a17b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:45.339185 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-88bb49c6-eb5e-4fb2-a1d1-7e1f8800a17b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 28679 microversion: 2.1 time: 0.075211 Jan 17 21:34:45.339885 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 666/1325] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:45 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 28679 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:46.352257 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7d5fa04e-1c5a-4808-8f2a-2d32b042507a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:46.353416 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7d5fa04e-1c5a-4808-8f2a-2d32b042507a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:46.360569 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7d5fa04e-1c5a-4808-8f2a-2d32b042507a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:46.361023 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7d5fa04e-1c5a-4808-8f2a-2d32b042507a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:46.361820 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7d5fa04e-1c5a-4808-8f2a-2d32b042507a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:46.362372 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7d5fa04e-1c5a-4808-8f2a-2d32b042507a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:46.439312 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7d5fa04e-1c5a-4808-8f2a-2d32b042507a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 29610 microversion: 2.1 time: 0.091108 Jan 17 21:34:46.440258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 660/1326] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:46 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 29610 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:47.451620 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-27941401-8e1d-4065-9e12-a71662ba9faa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:47.452697 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-27941401-8e1d-4065-9e12-a71662ba9faa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:47.460651 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-27941401-8e1d-4065-9e12-a71662ba9faa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:47.461117 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-27941401-8e1d-4065-9e12-a71662ba9faa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:47.461916 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-27941401-8e1d-4065-9e12-a71662ba9faa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:47.462363 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-27941401-8e1d-4065-9e12-a71662ba9faa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:47.538801 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-27941401-8e1d-4065-9e12-a71662ba9faa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 31726 microversion: 2.1 time: 0.091139 Jan 17 21:34:47.539744 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 667/1327] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:47 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 31726 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:48.551717 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a32c4a4b-4492-4398-bf95-247c34c47ed4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:48.552732 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a32c4a4b-4492-4398-bf95-247c34c47ed4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:48.559817 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a32c4a4b-4492-4398-bf95-247c34c47ed4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:48.560274 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a32c4a4b-4492-4398-bf95-247c34c47ed4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:48.561182 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a32c4a4b-4492-4398-bf95-247c34c47ed4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:48.561630 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a32c4a4b-4492-4398-bf95-247c34c47ed4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:48.636832 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a32c4a4b-4492-4398-bf95-247c34c47ed4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 32921 microversion: 2.1 time: 0.089571 Jan 17 21:34:48.637496 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 661/1328] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:48 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 32921 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:34:49.649074 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-482512a4-7e19-4371-98dd-fdcd7dd9bbcd tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:49.650112 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-482512a4-7e19-4371-98dd-fdcd7dd9bbcd tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:49.657013 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-482512a4-7e19-4371-98dd-fdcd7dd9bbcd tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:49.657469 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-482512a4-7e19-4371-98dd-fdcd7dd9bbcd tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:49.658256 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-482512a4-7e19-4371-98dd-fdcd7dd9bbcd tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:49.658697 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-482512a4-7e19-4371-98dd-fdcd7dd9bbcd tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:49.728877 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-482512a4-7e19-4371-98dd-fdcd7dd9bbcd tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 33869 microversion: 2.1 time: 0.083567 Jan 17 21:34:49.729531 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 668/1329] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:49 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 33869 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:50.741634 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9d8f773d-f57e-4775-96dd-c021ae3428a0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:50.742671 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-9d8f773d-f57e-4775-96dd-c021ae3428a0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:50.749589 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9d8f773d-f57e-4775-96dd-c021ae3428a0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:50.750047 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9d8f773d-f57e-4775-96dd-c021ae3428a0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:50.750832 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9d8f773d-f57e-4775-96dd-c021ae3428a0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:50.751275 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9d8f773d-f57e-4775-96dd-c021ae3428a0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:50.821344 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-9d8f773d-f57e-4775-96dd-c021ae3428a0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 35300 microversion: 2.1 time: 0.083937 Jan 17 21:34:50.822209 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 662/1330] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:50 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 35300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:51.834379 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-0f307eac-a5b7-4ac5-bccf-29aa48ad1561 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:51.835518 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-0f307eac-a5b7-4ac5-bccf-29aa48ad1561 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:51.842387 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0f307eac-a5b7-4ac5-bccf-29aa48ad1561 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:51.842849 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0f307eac-a5b7-4ac5-bccf-29aa48ad1561 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:51.843640 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0f307eac-a5b7-4ac5-bccf-29aa48ad1561 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:51.844087 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-0f307eac-a5b7-4ac5-bccf-29aa48ad1561 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:51.916828 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-0f307eac-a5b7-4ac5-bccf-29aa48ad1561 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 36827 microversion: 2.1 time: 0.087159 Jan 17 21:34:51.917536 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 669/1331] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:51 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 36827 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:52.929921 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3b933e1e-ffff-45bc-91f6-1847ba1151e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:52.930935 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3b933e1e-ffff-45bc-91f6-1847ba1151e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:52.937912 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3b933e1e-ffff-45bc-91f6-1847ba1151e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:52.938370 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3b933e1e-ffff-45bc-91f6-1847ba1151e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:52.939163 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3b933e1e-ffff-45bc-91f6-1847ba1151e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:52.939635 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3b933e1e-ffff-45bc-91f6-1847ba1151e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:53.017383 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3b933e1e-ffff-45bc-91f6-1847ba1151e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 38214 microversion: 2.1 time: 0.091341 Jan 17 21:34:53.018056 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 663/1332] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:52 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 38214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:54.030709 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2657b0d9-7fbf-4cce-80ab-4c2b88948cfb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:54.031722 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2657b0d9-7fbf-4cce-80ab-4c2b88948cfb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:54.039990 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2657b0d9-7fbf-4cce-80ab-4c2b88948cfb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:54.040770 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2657b0d9-7fbf-4cce-80ab-4c2b88948cfb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:54.041290 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2657b0d9-7fbf-4cce-80ab-4c2b88948cfb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:54.041740 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2657b0d9-7fbf-4cce-80ab-4c2b88948cfb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:54.104621 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2657b0d9-7fbf-4cce-80ab-4c2b88948cfb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 38214 microversion: 2.1 time: 0.077700 Jan 17 21:34:54.105287 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 670/1333] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:54 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 38214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:34:55.117461 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ffb985d8-399d-427c-963c-2e430cc3adb2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:55.118477 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ffb985d8-399d-427c-963c-2e430cc3adb2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:55.125820 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ffb985d8-399d-427c-963c-2e430cc3adb2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:55.126283 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ffb985d8-399d-427c-963c-2e430cc3adb2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:55.127093 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ffb985d8-399d-427c-963c-2e430cc3adb2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:55.128070 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ffb985d8-399d-427c-963c-2e430cc3adb2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:55.191685 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ffb985d8-399d-427c-963c-2e430cc3adb2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 38214 microversion: 2.1 time: 0.078088 Jan 17 21:34:55.192280 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 664/1334] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:55 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 38214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:34:56.205111 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-93576d06-a571-4572-b52e-39bc717ad2b6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:56.206637 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-93576d06-a571-4572-b52e-39bc717ad2b6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:56.213913 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-93576d06-a571-4572-b52e-39bc717ad2b6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:56.214372 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-93576d06-a571-4572-b52e-39bc717ad2b6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:56.215183 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-93576d06-a571-4572-b52e-39bc717ad2b6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:56.215627 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-93576d06-a571-4572-b52e-39bc717ad2b6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:56.275975 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-93576d06-a571-4572-b52e-39bc717ad2b6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 38214 microversion: 2.1 time: 0.074821 Jan 17 21:34:56.276584 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 671/1335] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:56 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 38214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:57.288245 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c6454b8d-570a-4967-8fe6-b464bef5da4d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:57.289189 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c6454b8d-570a-4967-8fe6-b464bef5da4d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:57.295905 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c6454b8d-570a-4967-8fe6-b464bef5da4d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:57.296357 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c6454b8d-570a-4967-8fe6-b464bef5da4d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:57.297201 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c6454b8d-570a-4967-8fe6-b464bef5da4d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:57.297691 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c6454b8d-570a-4967-8fe6-b464bef5da4d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:57.368598 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c6454b8d-570a-4967-8fe6-b464bef5da4d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 200 len: 38345 microversion: 2.1 time: 0.084866 Jan 17 21:34:57.369247 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 665/1336] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:34:57 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 38345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:34:57.380326 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ea007a94-2b17-41a8-be9a-0ae301e81b3f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:34:57.380933 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ea007a94-2b17-41a8-be9a-0ae301e81b3f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:57.387823 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ea007a94-2b17-41a8-be9a-0ae301e81b3f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:57.388279 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ea007a94-2b17-41a8-be9a-0ae301e81b3f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:57.389088 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ea007a94-2b17-41a8-be9a-0ae301e81b3f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:57.389533 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ea007a94-2b17-41a8-be9a-0ae301e81b3f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:57.413146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ea007a94-2b17-41a8-be9a-0ae301e81b3f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/ips" status: 200 len: 146 microversion: 2.1 time: 0.036821 Jan 17 21:34:57.413726 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 672/1337] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jan 17 21:34:57 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:34:59.736928 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-bbb0be55-b929-423e-8b1c-cb183b328720 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb13cb7d-f750-4831-b8cf-4380a00985a8"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:34:59.738071 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-bbb0be55-b929-423e-8b1c-cb183b328720 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:34:59.744946 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bbb0be55-b929-423e-8b1c-cb183b328720 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:59.745417 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bbb0be55-b929-423e-8b1c-cb183b328720 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:59.746191 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bbb0be55-b929-423e-8b1c-cb183b328720 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:34:59.746634 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bbb0be55-b929-423e-8b1c-cb183b328720 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:34:59.973324 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-bbb0be55-b929-423e-8b1c-cb183b328720 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240253 Jan 17 21:34:59.973940 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 666/1338] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jan 17 21:34:59 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:35:07.433062 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-2405b75a-e215-4f88-a612-78815ca563bf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:35:07.439491 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2405b75a-e215-4f88-a612-78815ca563bf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:07.439988 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-2405b75a-e215-4f88-a612-78815ca563bf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:07.501392 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-2405b75a-e215-4f88-a612-78815ca563bf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Going to try to stop instance {{(pid=116182) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 17 21:35:07.542896 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-2405b75a-e215-4f88-a612-78815ca563bf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 202 len: 0 microversion: 2.1 time: 0.113338 Jan 17 21:35:07.543505 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 673/1339] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:35:07 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:35:07.552976 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-bdb395ac-81d4-4d8b-b056-e8b866419ac1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:07.553683 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-bdb395ac-81d4-4d8b-b056-e8b866419ac1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:07.560181 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bdb395ac-81d4-4d8b-b056-e8b866419ac1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:07.560775 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bdb395ac-81d4-4d8b-b056-e8b866419ac1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:07.561662 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bdb395ac-81d4-4d8b-b056-e8b866419ac1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:07.562069 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bdb395ac-81d4-4d8b-b056-e8b866419ac1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:07.700778 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-bdb395ac-81d4-4d8b-b056-e8b866419ac1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:07.709001 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-bdb395ac-81d4-4d8b-b056-e8b866419ac1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1723 microversion: 2.1 time: 0.160995 Jan 17 21:35:07.709605 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 667/1340] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:07 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:35:08.727181 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-eaaa7d9a-24a2-4ca6-92e9-bcb4089790f8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:08.727905 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-eaaa7d9a-24a2-4ca6-92e9-bcb4089790f8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:08.733970 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eaaa7d9a-24a2-4ca6-92e9-bcb4089790f8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:08.734420 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eaaa7d9a-24a2-4ca6-92e9-bcb4089790f8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:08.735195 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eaaa7d9a-24a2-4ca6-92e9-bcb4089790f8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:08.735633 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eaaa7d9a-24a2-4ca6-92e9-bcb4089790f8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:08.870762 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-eaaa7d9a-24a2-4ca6-92e9-bcb4089790f8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:08.878671 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-eaaa7d9a-24a2-4ca6-92e9-bcb4089790f8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1723 microversion: 2.1 time: 0.155920 Jan 17 21:35:08.879731 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 674/1341] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:08 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:35:09.896892 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b78b11a8-1bde-40d6-83a8-4060d3969518 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:09.897491 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b78b11a8-1bde-40d6-83a8-4060d3969518 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:09.903820 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b78b11a8-1bde-40d6-83a8-4060d3969518 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:09.904279 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b78b11a8-1bde-40d6-83a8-4060d3969518 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:09.905091 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b78b11a8-1bde-40d6-83a8-4060d3969518 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:09.905535 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b78b11a8-1bde-40d6-83a8-4060d3969518 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:10.044485 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b78b11a8-1bde-40d6-83a8-4060d3969518 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:10.052156 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b78b11a8-1bde-40d6-83a8-4060d3969518 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1723 microversion: 2.1 time: 0.159593 Jan 17 21:35:10.052747 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 668/1342] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:09 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:35:11.068396 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b92dca96-f012-40d0-a048-ed9b3a6bd738 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:11.069016 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b92dca96-f012-40d0-a048-ed9b3a6bd738 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:11.075393 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b92dca96-f012-40d0-a048-ed9b3a6bd738 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:11.075874 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b92dca96-f012-40d0-a048-ed9b3a6bd738 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:11.076698 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b92dca96-f012-40d0-a048-ed9b3a6bd738 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:11.077146 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b92dca96-f012-40d0-a048-ed9b3a6bd738 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:11.205298 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-b92dca96-f012-40d0-a048-ed9b3a6bd738 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:11.213860 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b92dca96-f012-40d0-a048-ed9b3a6bd738 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1723 microversion: 2.1 time: 0.149260 Jan 17 21:35:11.214422 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 675/1343] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:11 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:35:12.231964 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3e4faf85-fd43-40cb-a592-ae766b7baaef tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:12.232586 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3e4faf85-fd43-40cb-a592-ae766b7baaef tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:12.240037 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3e4faf85-fd43-40cb-a592-ae766b7baaef tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:12.240466 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3e4faf85-fd43-40cb-a592-ae766b7baaef tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:12.241258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3e4faf85-fd43-40cb-a592-ae766b7baaef tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:12.241698 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3e4faf85-fd43-40cb-a592-ae766b7baaef tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:12.376043 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3e4faf85-fd43-40cb-a592-ae766b7baaef tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:12.383880 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3e4faf85-fd43-40cb-a592-ae766b7baaef tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1723 microversion: 2.1 time: 0.155578 Jan 17 21:35:12.384482 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 669/1344] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:12 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:35:13.401192 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ca146c38-1a9e-476d-871c-a3da9c7da9f1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:13.401812 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ca146c38-1a9e-476d-871c-a3da9c7da9f1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:13.408104 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca146c38-1a9e-476d-871c-a3da9c7da9f1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:13.408606 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca146c38-1a9e-476d-871c-a3da9c7da9f1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:13.409399 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca146c38-1a9e-476d-871c-a3da9c7da9f1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:13.409867 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca146c38-1a9e-476d-871c-a3da9c7da9f1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:13.535490 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ca146c38-1a9e-476d-871c-a3da9c7da9f1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:13.543851 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ca146c38-1a9e-476d-871c-a3da9c7da9f1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1723 microversion: 2.1 time: 0.146294 Jan 17 21:35:13.544441 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 676/1345] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:13 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:35:14.561094 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-89fd1618-bb8e-48f8-abc9-6d67786c70be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:14.561702 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-89fd1618-bb8e-48f8-abc9-6d67786c70be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:14.568540 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-89fd1618-bb8e-48f8-abc9-6d67786c70be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:14.568997 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-89fd1618-bb8e-48f8-abc9-6d67786c70be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:14.569772 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-89fd1618-bb8e-48f8-abc9-6d67786c70be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:14.570216 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-89fd1618-bb8e-48f8-abc9-6d67786c70be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:14.695757 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-89fd1618-bb8e-48f8-abc9-6d67786c70be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:14.703450 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-89fd1618-bb8e-48f8-abc9-6d67786c70be tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1723 microversion: 2.1 time: 0.146080 Jan 17 21:35:14.704019 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 670/1346] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:14 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:35:15.721264 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-653aa3e5-115e-4e6b-8a7f-afafa5f41ced tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:15.721867 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-653aa3e5-115e-4e6b-8a7f-afafa5f41ced tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:15.728296 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-653aa3e5-115e-4e6b-8a7f-afafa5f41ced tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:15.728790 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-653aa3e5-115e-4e6b-8a7f-afafa5f41ced tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:15.729588 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-653aa3e5-115e-4e6b-8a7f-afafa5f41ced tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:15.730035 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-653aa3e5-115e-4e6b-8a7f-afafa5f41ced tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:16.068725 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-653aa3e5-115e-4e6b-8a7f-afafa5f41ced tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:16.076393 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-653aa3e5-115e-4e6b-8a7f-afafa5f41ced tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1723 microversion: 2.1 time: 0.358808 Jan 17 21:35:16.076973 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 677/1347] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:15 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:35:17.093933 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7f27fb41-065f-4f2a-871e-3844962f9507 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:17.094543 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7f27fb41-065f-4f2a-871e-3844962f9507 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:17.101394 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7f27fb41-065f-4f2a-871e-3844962f9507 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:17.101846 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7f27fb41-065f-4f2a-871e-3844962f9507 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:17.102626 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7f27fb41-065f-4f2a-871e-3844962f9507 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:17.103066 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7f27fb41-065f-4f2a-871e-3844962f9507 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:17.284552 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7f27fb41-065f-4f2a-871e-3844962f9507 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:17.292943 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7f27fb41-065f-4f2a-871e-3844962f9507 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1723 microversion: 2.1 time: 0.202708 Jan 17 21:35:17.293504 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 671/1348] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:17 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:35:18.309863 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-bd99d752-379d-4b0f-b36f-0cc9fa2dd6b2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:18.310413 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-bd99d752-379d-4b0f-b36f-0cc9fa2dd6b2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:18.316729 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bd99d752-379d-4b0f-b36f-0cc9fa2dd6b2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:18.317176 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bd99d752-379d-4b0f-b36f-0cc9fa2dd6b2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:18.318816 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bd99d752-379d-4b0f-b36f-0cc9fa2dd6b2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:18.318985 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-bd99d752-379d-4b0f-b36f-0cc9fa2dd6b2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:18.451150 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-bd99d752-379d-4b0f-b36f-0cc9fa2dd6b2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:18.459692 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-bd99d752-379d-4b0f-b36f-0cc9fa2dd6b2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1723 microversion: 2.1 time: 0.153557 Jan 17 21:35:18.460254 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 678/1349] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:18 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:35:19.477236 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ad80d38f-3e46-4377-9d81-4c698ed9d5c6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:19.477852 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ad80d38f-3e46-4377-9d81-4c698ed9d5c6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:19.484109 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ad80d38f-3e46-4377-9d81-4c698ed9d5c6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:19.484604 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ad80d38f-3e46-4377-9d81-4c698ed9d5c6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:19.485384 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ad80d38f-3e46-4377-9d81-4c698ed9d5c6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:19.485821 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ad80d38f-3e46-4377-9d81-4c698ed9d5c6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:19.610703 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-ad80d38f-3e46-4377-9d81-4c698ed9d5c6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:19.618723 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ad80d38f-3e46-4377-9d81-4c698ed9d5c6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1723 microversion: 2.1 time: 0.145786 Jan 17 21:35:19.619288 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 672/1350] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:19 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:35:20.635993 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-789a79f7-2277-4be4-974e-f8829cde6d04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:20.636729 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-789a79f7-2277-4be4-974e-f8829cde6d04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:20.643656 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-789a79f7-2277-4be4-974e-f8829cde6d04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:20.644110 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-789a79f7-2277-4be4-974e-f8829cde6d04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:20.645206 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-789a79f7-2277-4be4-974e-f8829cde6d04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:20.645703 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-789a79f7-2277-4be4-974e-f8829cde6d04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:20.782598 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-789a79f7-2277-4be4-974e-f8829cde6d04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:20.790888 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-789a79f7-2277-4be4-974e-f8829cde6d04 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1723 microversion: 2.1 time: 0.158531 Jan 17 21:35:20.791478 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 679/1351] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:20 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:35:21.808221 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b82ea5f1-f153-4322-bda4-4642220d5c50 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:21.808851 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b82ea5f1-f153-4322-bda4-4642220d5c50 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:21.815096 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b82ea5f1-f153-4322-bda4-4642220d5c50 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:21.815544 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b82ea5f1-f153-4322-bda4-4642220d5c50 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:21.816317 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b82ea5f1-f153-4322-bda4-4642220d5c50 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:21.816774 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b82ea5f1-f153-4322-bda4-4642220d5c50 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:21.949359 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b82ea5f1-f153-4322-bda4-4642220d5c50 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:21.957227 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b82ea5f1-f153-4322-bda4-4642220d5c50 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1723 microversion: 2.1 time: 0.152623 Jan 17 21:35:21.958064 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 673/1352] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:21 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:35:22.975237 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f70f6ca4-cc80-449d-9aa9-1cd0b66e3a18 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:22.975870 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-f70f6ca4-cc80-449d-9aa9-1cd0b66e3a18 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:22.982491 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f70f6ca4-cc80-449d-9aa9-1cd0b66e3a18 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:22.982983 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f70f6ca4-cc80-449d-9aa9-1cd0b66e3a18 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:22.983774 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f70f6ca4-cc80-449d-9aa9-1cd0b66e3a18 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:22.984294 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-f70f6ca4-cc80-449d-9aa9-1cd0b66e3a18 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:23.115345 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-f70f6ca4-cc80-449d-9aa9-1cd0b66e3a18 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:23.123466 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f70f6ca4-cc80-449d-9aa9-1cd0b66e3a18 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1700 microversion: 2.1 time: 0.152449 Jan 17 21:35:23.124050 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 680/1353] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:22 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1700 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:35:23.140051 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f9e6a024-67a3-4b9e-8c36-47958a4242c7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:35:23.146965 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f9e6a024-67a3-4b9e-8c36-47958a4242c7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:23.147421 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f9e6a024-67a3-4b9e-8c36-47958a4242c7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:23.206478 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f9e6a024-67a3-4b9e-8c36-47958a4242c7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Going to try to start instance {{(pid=116183) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 17 21:35:23.249642 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f9e6a024-67a3-4b9e-8c36-47958a4242c7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 202 len: 0 microversion: 2.1 time: 0.113082 Jan 17 21:35:23.250330 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 674/1354] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:35:23 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:35:23.258317 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-033ae88a-8f1f-4f16-8708-44b11dc91336 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:23.258929 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-033ae88a-8f1f-4f16-8708-44b11dc91336 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:23.264817 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-033ae88a-8f1f-4f16-8708-44b11dc91336 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:23.265288 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-033ae88a-8f1f-4f16-8708-44b11dc91336 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:23.266182 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-033ae88a-8f1f-4f16-8708-44b11dc91336 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:23.266685 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-033ae88a-8f1f-4f16-8708-44b11dc91336 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:23.403250 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-033ae88a-8f1f-4f16-8708-44b11dc91336 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:23.411367 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-033ae88a-8f1f-4f16-8708-44b11dc91336 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1709 microversion: 2.1 time: 0.156742 Jan 17 21:35:23.411945 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 681/1355] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:23 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:35:24.429881 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7e27c63d-05cb-4005-b0ce-82f27d4ddffb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:35:24.430762 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7e27c63d-05cb-4005-b0ce-82f27d4ddffb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:35:24.437520 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7e27c63d-05cb-4005-b0ce-82f27d4ddffb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:24.438031 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7e27c63d-05cb-4005-b0ce-82f27d4ddffb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:24.438902 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7e27c63d-05cb-4005-b0ce-82f27d4ddffb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:35:24.439324 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7e27c63d-05cb-4005-b0ce-82f27d4ddffb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:35:24.581403 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-7e27c63d-05cb-4005-b0ce-82f27d4ddffb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:35:24.589612 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7e27c63d-05cb-4005-b0ce-82f27d4ddffb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1713 microversion: 2.1 time: 0.164254 Jan 17 21:35:24.590199 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 675/1356] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:35:24 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1713 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:36:21.143295 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ac1c6afa-e06d-4813-950c-bf5c58b6310a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:36:21.143900 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ac1c6afa-e06d-4813-950c-bf5c58b6310a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:36:21.150035 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac1c6afa-e06d-4813-950c-bf5c58b6310a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:21.150492 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac1c6afa-e06d-4813-950c-bf5c58b6310a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:21.151289 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac1c6afa-e06d-4813-950c-bf5c58b6310a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:21.151736 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ac1c6afa-e06d-4813-950c-bf5c58b6310a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:21.230305 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-ac1c6afa-e06d-4813-950c-bf5c58b6310a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lazy-loading 'services' on Instance uuid 36e5d4f4-8056-4422-9c56-c4d15421e8ff {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:36:21.300006 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ac1c6afa-e06d-4813-950c-bf5c58b6310a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "DELETE /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/os-volume_attachments/bb13cb7d-f750-4831-b8cf-4380a00985a8" status: 202 len: 0 microversion: 2.1 time: 0.160439 Jan 17 21:36:21.300621 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 682/1357] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jan 17 21:36:21 2022] DELETE /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/os-volume_attachments/bb13cb7d-f750-4831-b8cf-4380a00985a8 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:36:22.414815 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ec7b8e2f-87ad-4f80-af88-ca640b891130 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:36:22.421118 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec7b8e2f-87ad-4f80-af88-ca640b891130 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:22.421577 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ec7b8e2f-87ad-4f80-af88-ca640b891130 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:22.443678 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ec7b8e2f-87ad-4f80-af88-ca640b891130 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Going to try to stop instance {{(pid=116183) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 17 21:36:22.488995 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ec7b8e2f-87ad-4f80-af88-ca640b891130 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 202 len: 0 microversion: 2.1 time: 0.078325 Jan 17 21:36:22.489591 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 676/1358] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:36:22 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:36:22.498222 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-eb50cef3-020b-4d72-bebe-0579d66e661d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:36:22.498898 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-eb50cef3-020b-4d72-bebe-0579d66e661d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:36:22.506297 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eb50cef3-020b-4d72-bebe-0579d66e661d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:22.506865 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eb50cef3-020b-4d72-bebe-0579d66e661d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:22.507808 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eb50cef3-020b-4d72-bebe-0579d66e661d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:22.508262 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-eb50cef3-020b-4d72-bebe-0579d66e661d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:22.655983 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-eb50cef3-020b-4d72-bebe-0579d66e661d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:36:22.663787 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-eb50cef3-020b-4d72-bebe-0579d66e661d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1677 microversion: 2.1 time: 0.169469 Jan 17 21:36:22.664395 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 683/1359] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:36:22 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:36:23.685107 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1a56a39e-05a9-4aad-ac8b-f912c654a98e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:36:23.685813 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1a56a39e-05a9-4aad-ac8b-f912c654a98e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:36:23.692188 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1a56a39e-05a9-4aad-ac8b-f912c654a98e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:23.692682 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1a56a39e-05a9-4aad-ac8b-f912c654a98e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:23.693494 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1a56a39e-05a9-4aad-ac8b-f912c654a98e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:23.693940 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1a56a39e-05a9-4aad-ac8b-f912c654a98e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:23.829088 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1a56a39e-05a9-4aad-ac8b-f912c654a98e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:36:23.838009 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1a56a39e-05a9-4aad-ac8b-f912c654a98e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1677 microversion: 2.1 time: 0.159408 Jan 17 21:36:23.838589 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 677/1360] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:36:23 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:36:24.856844 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fe6626e9-9b7f-45ae-83f0-8b42a5a53ae8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:36:24.857586 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fe6626e9-9b7f-45ae-83f0-8b42a5a53ae8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:36:24.864033 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fe6626e9-9b7f-45ae-83f0-8b42a5a53ae8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:24.864532 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fe6626e9-9b7f-45ae-83f0-8b42a5a53ae8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:24.865429 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fe6626e9-9b7f-45ae-83f0-8b42a5a53ae8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:24.865767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fe6626e9-9b7f-45ae-83f0-8b42a5a53ae8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:25.014947 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-fe6626e9-9b7f-45ae-83f0-8b42a5a53ae8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:36:25.023177 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fe6626e9-9b7f-45ae-83f0-8b42a5a53ae8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1677 microversion: 2.1 time: 0.170155 Jan 17 21:36:25.023761 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 684/1361] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:36:24 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:36:26.041004 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5f144fca-f874-496a-8814-d0a27989e2ac tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:36:26.041599 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5f144fca-f874-496a-8814-d0a27989e2ac tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:36:26.048234 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5f144fca-f874-496a-8814-d0a27989e2ac tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:26.048714 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5f144fca-f874-496a-8814-d0a27989e2ac tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:26.049498 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5f144fca-f874-496a-8814-d0a27989e2ac tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:26.049935 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5f144fca-f874-496a-8814-d0a27989e2ac tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:26.189809 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5f144fca-f874-496a-8814-d0a27989e2ac tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:36:26.197813 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5f144fca-f874-496a-8814-d0a27989e2ac tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1677 microversion: 2.1 time: 0.161068 Jan 17 21:36:26.198371 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 678/1362] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:36:26 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:36:27.215645 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-40063eaf-ceef-45b3-93bb-0adc0dd8a030 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:36:27.216292 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-40063eaf-ceef-45b3-93bb-0adc0dd8a030 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:36:27.222811 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-40063eaf-ceef-45b3-93bb-0adc0dd8a030 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:27.223299 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-40063eaf-ceef-45b3-93bb-0adc0dd8a030 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:27.224144 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-40063eaf-ceef-45b3-93bb-0adc0dd8a030 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:27.225001 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-40063eaf-ceef-45b3-93bb-0adc0dd8a030 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:27.363845 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-40063eaf-ceef-45b3-93bb-0adc0dd8a030 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:36:27.371973 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-40063eaf-ceef-45b3-93bb-0adc0dd8a030 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1677 microversion: 2.1 time: 0.160177 Jan 17 21:36:27.372611 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 685/1363] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:36:27 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:36:28.388557 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-9d508947-51ec-4ce4-869a-8b035c39d576 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:36:28.389186 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-9d508947-51ec-4ce4-869a-8b035c39d576 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:36:28.395683 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9d508947-51ec-4ce4-869a-8b035c39d576 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:28.396135 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9d508947-51ec-4ce4-869a-8b035c39d576 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:28.396997 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9d508947-51ec-4ce4-869a-8b035c39d576 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:28.397959 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-9d508947-51ec-4ce4-869a-8b035c39d576 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:28.535774 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-9d508947-51ec-4ce4-869a-8b035c39d576 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:36:28.543984 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-9d508947-51ec-4ce4-869a-8b035c39d576 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1677 microversion: 2.1 time: 0.158864 Jan 17 21:36:28.544621 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 679/1364] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:36:28 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:36:29.561309 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-de9630f1-ceac-4af9-9118-ea058f4916b6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:36:29.561928 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-de9630f1-ceac-4af9-9118-ea058f4916b6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:36:29.568365 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-de9630f1-ceac-4af9-9118-ea058f4916b6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:29.568850 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-de9630f1-ceac-4af9-9118-ea058f4916b6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:29.569647 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-de9630f1-ceac-4af9-9118-ea058f4916b6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:29.570095 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-de9630f1-ceac-4af9-9118-ea058f4916b6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:29.704142 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-de9630f1-ceac-4af9-9118-ea058f4916b6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:36:29.712285 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-de9630f1-ceac-4af9-9118-ea058f4916b6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1677 microversion: 2.1 time: 0.154654 Jan 17 21:36:29.712880 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 686/1365] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:36:29 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:36:30.729581 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1795d9d5-589b-4511-be75-35a4b16c3387 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:36:30.730206 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1795d9d5-589b-4511-be75-35a4b16c3387 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:36:30.736698 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1795d9d5-589b-4511-be75-35a4b16c3387 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:30.737162 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1795d9d5-589b-4511-be75-35a4b16c3387 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:30.737970 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1795d9d5-589b-4511-be75-35a4b16c3387 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:30.738418 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1795d9d5-589b-4511-be75-35a4b16c3387 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:30.880240 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-1795d9d5-589b-4511-be75-35a4b16c3387 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:36:30.887946 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1795d9d5-589b-4511-be75-35a4b16c3387 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1677 microversion: 2.1 time: 0.161937 Jan 17 21:36:30.888554 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 680/1366] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:36:30 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:36:31.905068 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-9e49e2db-3c5e-4469-a6a1-4a5764c418a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:36:31.905802 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-9e49e2db-3c5e-4469-a6a1-4a5764c418a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:36:31.912499 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9e49e2db-3c5e-4469-a6a1-4a5764c418a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:31.913003 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9e49e2db-3c5e-4469-a6a1-4a5764c418a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:31.913999 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9e49e2db-3c5e-4469-a6a1-4a5764c418a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:31.914448 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9e49e2db-3c5e-4469-a6a1-4a5764c418a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:32.053289 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-9e49e2db-3c5e-4469-a6a1-4a5764c418a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:36:32.061541 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-9e49e2db-3c5e-4469-a6a1-4a5764c418a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1677 microversion: 2.1 time: 0.160053 Jan 17 21:36:32.062134 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 687/1367] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:36:31 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:36:33.079485 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0470d30a-89aa-4c10-84b3-229476dd6d5c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:36:33.080224 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-0470d30a-89aa-4c10-84b3-229476dd6d5c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:36:33.087601 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0470d30a-89aa-4c10-84b3-229476dd6d5c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:33.088066 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0470d30a-89aa-4c10-84b3-229476dd6d5c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:33.088901 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0470d30a-89aa-4c10-84b3-229476dd6d5c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:33.089343 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0470d30a-89aa-4c10-84b3-229476dd6d5c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:33.253418 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-0470d30a-89aa-4c10-84b3-229476dd6d5c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:36:33.266811 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-0470d30a-89aa-4c10-84b3-229476dd6d5c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1654 microversion: 2.1 time: 0.190531 Jan 17 21:36:33.267886 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 681/1368] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:36:33 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1654 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:36:33.285147 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1146df69-ed31-45e3-955a-48f8019ce391 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:36:33.294398 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1146df69-ed31-45e3-955a-48f8019ce391 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:33.295081 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1146df69-ed31-45e3-955a-48f8019ce391 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:33.321384 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1146df69-ed31-45e3-955a-48f8019ce391 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Going to try to start instance {{(pid=116182) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 17 21:36:33.373357 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1146df69-ed31-45e3-955a-48f8019ce391 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action" status: 202 len: 0 microversion: 2.1 time: 0.091467 Jan 17 21:36:33.374246 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 688/1369] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:36:33 2022] POST /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:36:33.387222 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4c8ac70f-fd84-404a-a827-539df9e0b65a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:36:33.388156 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4c8ac70f-fd84-404a-a827-539df9e0b65a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:36:33.396042 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c8ac70f-fd84-404a-a827-539df9e0b65a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:33.396582 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c8ac70f-fd84-404a-a827-539df9e0b65a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:33.398000 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c8ac70f-fd84-404a-a827-539df9e0b65a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:33.398445 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c8ac70f-fd84-404a-a827-539df9e0b65a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:33.549337 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-4c8ac70f-fd84-404a-a827-539df9e0b65a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:36:33.563278 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4c8ac70f-fd84-404a-a827-539df9e0b65a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1663 microversion: 2.1 time: 0.179358 Jan 17 21:36:33.564577 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 682/1370] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:36:33 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1663 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:36:34.583558 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7b232258-0816-4bb1-850c-5840d04a5817 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:36:34.584458 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7b232258-0816-4bb1-850c-5840d04a5817 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:36:34.591138 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7b232258-0816-4bb1-850c-5840d04a5817 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:34.591622 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7b232258-0816-4bb1-850c-5840d04a5817 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:34.592584 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7b232258-0816-4bb1-850c-5840d04a5817 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:34.592911 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7b232258-0816-4bb1-850c-5840d04a5817 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:34.754985 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-7b232258-0816-4bb1-850c-5840d04a5817 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:36:34.764977 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7b232258-0816-4bb1-850c-5840d04a5817 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1663 microversion: 2.1 time: 0.186348 Jan 17 21:36:34.766164 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 689/1371] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:36:34 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1663 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:36:35.785481 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-681876fa-155c-4ff5-bd33-6b3fa4c4a286 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:36:35.786385 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-681876fa-155c-4ff5-bd33-6b3fa4c4a286 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:36:35.794005 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-681876fa-155c-4ff5-bd33-6b3fa4c4a286 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:35.794458 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-681876fa-155c-4ff5-bd33-6b3fa4c4a286 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:35.795284 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-681876fa-155c-4ff5-bd33-6b3fa4c4a286 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:36:35.795732 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-681876fa-155c-4ff5-bd33-6b3fa4c4a286 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:36:35.968762 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-681876fa-155c-4ff5-bd33-6b3fa4c4a286 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:36:35.977584 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-681876fa-155c-4ff5-bd33-6b3fa4c4a286 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1667 microversion: 2.1 time: 0.196133 Jan 17 21:36:35.977584 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 683/1372] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:36:35 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1667 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:36:56.267884 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:36:56.268609 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: Mon Jan 17 21:36:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 21:37:08.749224 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:37:08.749856 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: Mon Jan 17 21:37:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 21:37:39.342350 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7cafa6e2-a374-4253-a061-c93c70b7c5c5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:39.343925 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7cafa6e2-a374-4253-a061-c93c70b7c5c5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:39.354686 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7cafa6e2-a374-4253-a061-c93c70b7c5c5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:39.355523 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7cafa6e2-a374-4253-a061-c93c70b7c5c5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:39.356599 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7cafa6e2-a374-4253-a061-c93c70b7c5c5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:39.357048 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7cafa6e2-a374-4253-a061-c93c70b7c5c5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:39.390041 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7cafa6e2-a374-4253-a061-c93c70b7c5c5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053904 Jan 17 21:37:39.390581 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 690/1373] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:37:39 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:37:39.447859 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f05c36af-53d7-4289-a60e-a7bc38d2983e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:39.448468 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f05c36af-53d7-4289-a60e-a7bc38d2983e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:39.454400 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f05c36af-53d7-4289-a60e-a7bc38d2983e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:39.454857 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f05c36af-53d7-4289-a60e-a7bc38d2983e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:39.455662 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f05c36af-53d7-4289-a60e-a7bc38d2983e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:39.456085 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f05c36af-53d7-4289-a60e-a7bc38d2983e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:39.481778 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f05c36af-53d7-4289-a60e-a7bc38d2983e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Going to try to terminate instance {{(pid=116183) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:37:39.554506 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f05c36af-53d7-4289-a60e-a7bc38d2983e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "DELETE /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 204 len: 0 microversion: 2.1 time: 0.110358 Jan 17 21:37:39.555036 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 684/1374] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:37:39 2022] DELETE /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:37:39.563666 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-15bf8ebe-5491-41c4-9ad1-6b28d7b8bc69 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:39.564318 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-15bf8ebe-5491-41c4-9ad1-6b28d7b8bc69 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:39.571048 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-15bf8ebe-5491-41c4-9ad1-6b28d7b8bc69 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:39.571496 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-15bf8ebe-5491-41c4-9ad1-6b28d7b8bc69 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:39.572289 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-15bf8ebe-5491-41c4-9ad1-6b28d7b8bc69 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:39.572760 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-15bf8ebe-5491-41c4-9ad1-6b28d7b8bc69 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:39.701378 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-15bf8ebe-5491-41c4-9ad1-6b28d7b8bc69 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:37:39.709122 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-15bf8ebe-5491-41c4-9ad1-6b28d7b8bc69 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1673 microversion: 2.1 time: 0.149238 Jan 17 21:37:39.709693 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 691/1375] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:37:39 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:37:40.727158 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3472b6e8-13f6-4293-b0d0-88d952f0dfc2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:40.727858 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3472b6e8-13f6-4293-b0d0-88d952f0dfc2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:40.734419 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3472b6e8-13f6-4293-b0d0-88d952f0dfc2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:40.734871 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3472b6e8-13f6-4293-b0d0-88d952f0dfc2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:40.735670 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3472b6e8-13f6-4293-b0d0-88d952f0dfc2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:40.736108 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3472b6e8-13f6-4293-b0d0-88d952f0dfc2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:40.866436 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-3472b6e8-13f6-4293-b0d0-88d952f0dfc2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:37:40.874129 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3472b6e8-13f6-4293-b0d0-88d952f0dfc2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1673 microversion: 2.1 time: 0.150955 Jan 17 21:37:40.874887 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 685/1376] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:37:40 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:37:41.892069 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5d019317-a239-4793-8eae-c0351ed2f61f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:41.892707 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5d019317-a239-4793-8eae-c0351ed2f61f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:41.900298 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5d019317-a239-4793-8eae-c0351ed2f61f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:41.900785 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5d019317-a239-4793-8eae-c0351ed2f61f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:41.901590 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5d019317-a239-4793-8eae-c0351ed2f61f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:41.902030 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5d019317-a239-4793-8eae-c0351ed2f61f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:42.038510 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-5d019317-a239-4793-8eae-c0351ed2f61f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:37:42.046167 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5d019317-a239-4793-8eae-c0351ed2f61f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1673 microversion: 2.1 time: 0.157856 Jan 17 21:37:42.046746 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 692/1377] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:37:41 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:37:42.790673 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-2cba66aa-d7ce-4c62-8097-ec03bb16969d req-60cfa167-7c28-4999-8a80-9d88070faaca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e5d4f4-8056-4422-9c56-c4d15421e8ff", "name": "network-vif-deleted", "tag": "bc270e6d-36cd-419d-a53e-2a49d7402731"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:37:42.793090 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:37:42.793090 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:37:42.801361 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-2cba66aa-d7ce-4c62-8097-ec03bb16969d req-60cfa167-7c28-4999-8a80-9d88070faaca service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:42.801899 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-2cba66aa-d7ce-4c62-8097-ec03bb16969d req-60cfa167-7c28-4999-8a80-9d88070faaca service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:42.822678 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-2cba66aa-d7ce-4c62-8097-ec03bb16969d req-60cfa167-7c28-4999-8a80-9d88070faaca service nova] Creating event network-vif-deleted:bc270e6d-36cd-419d-a53e-2a49d7402731 for instance 36e5d4f4-8056-4422-9c56-c4d15421e8ff on hv-cinder-82489 Jan 17 21:37:42.827910 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-2cba66aa-d7ce-4c62-8097-ec03bb16969d req-60cfa167-7c28-4999-8a80-9d88070faaca service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113690 Jan 17 21:37:42.829177 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 686/1378] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:37:43.062827 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e8b29f32-28df-420f-b646-5886fbddae6f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:43.063514 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e8b29f32-28df-420f-b646-5886fbddae6f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:43.071795 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e8b29f32-28df-420f-b646-5886fbddae6f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:43.073555 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e8b29f32-28df-420f-b646-5886fbddae6f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:43.074566 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e8b29f32-28df-420f-b646-5886fbddae6f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:43.075461 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e8b29f32-28df-420f-b646-5886fbddae6f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:43.114808 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e8b29f32-28df-420f-b646-5886fbddae6f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:43.115556 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e8b29f32-28df-420f-b646-5886fbddae6f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:43.116778 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-e8b29f32-28df-420f-b646-5886fbddae6f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lazy-loading 'fault' on Instance uuid 36e5d4f4-8056-4422-9c56-c4d15421e8ff {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:37:43.160514 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-e8b29f32-28df-420f-b646-5886fbddae6f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:37:43.171977 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e8b29f32-28df-420f-b646-5886fbddae6f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 200 len: 1327 microversion: 2.1 time: 0.112696 Jan 17 21:37:43.180889 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 693/1379] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:37:43 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 1327 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:37:44.190938 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f0f2332d-305e-400b-ad1b-3acb1643a0e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:44.191632 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f0f2332d-305e-400b-ad1b-3acb1643a0e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:44.198447 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f0f2332d-305e-400b-ad1b-3acb1643a0e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:44.198900 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f0f2332d-305e-400b-ad1b-3acb1643a0e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:44.199683 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f0f2332d-305e-400b-ad1b-3acb1643a0e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:44.200124 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f0f2332d-305e-400b-ad1b-3acb1643a0e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:44.213103 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-f0f2332d-305e-400b-ad1b-3acb1643a0e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] HTTP exception thrown: Instance 36e5d4f4-8056-4422-9c56-c4d15421e8ff could not be found. Jan 17 21:37:44.213685 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f0f2332d-305e-400b-ad1b-3acb1643a0e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Returning 404 to user: Instance 36e5d4f4-8056-4422-9c56-c4d15421e8ff could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:37:44.214500 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f0f2332d-305e-400b-ad1b-3acb1643a0e6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 404 len: 111 microversion: 2.1 time: 0.028086 Jan 17 21:37:44.215028 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 687/1380] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:37:44 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:37:44.223218 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-f3e19d17-202a-4dfb-b565-99e08a33a3d0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '.version_select at 0x7f8975e5a670>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:44.244566 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-f3e19d17-202a-4dfb-b565-99e08a33a3d0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-698782818" status: 202 len: 0 microversion: 2.1 time: 0.024817 Jan 17 21:37:44.245144 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 694/1381] 10.222.0.64 () {58 vars in 1217 bytes} [Mon Jan 17 21:37:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-698782818 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:37:44.894577 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-619216d5-e1d4-47cb-a78e-90ec7b5988b7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'create', calling method: .version_select at 0x7f8976b97ee0>, body: {"keypair": {"name": "tempest-keypair-1846209742"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:37:44.908364 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-619216d5-e1d4-47cb-a78e-90ec7b5988b7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Getting quotas for project 8b4ad2da51ac441986f9af1c8c6a30c1. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:37:44.912101 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-619216d5-e1d4-47cb-a78e-90ec7b5988b7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Getting quotas for user 844c17f7d55f4d66893be8af81851331 and project 8b4ad2da51ac441986f9af1c8c6a30c1. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:37:45.107005 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-619216d5-e1d4-47cb-a78e-90ec7b5988b7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Getting quotas for project 8b4ad2da51ac441986f9af1c8c6a30c1. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:37:45.110698 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.quota [None req-619216d5-e1d4-47cb-a78e-90ec7b5988b7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Getting quotas for user 844c17f7d55f4d66893be8af81851331 and project 8b4ad2da51ac441986f9af1c8c6a30c1. Resources: {'key_pairs'} {{(pid=116183) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:37:45.123654 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-619216d5-e1d4-47cb-a78e-90ec7b5988b7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.232681 Jan 17 21:37:45.124244 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 688/1382] 10.222.0.64 () {60 vars in 1157 bytes} [Mon Jan 17 21:37:44 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:37:46.622349 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1953395217", "imageRef": "10ea5b4b-b70d-4716-a51b-01169c4ad887", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d83dab97-84dd-4ed1-960a-d73699e6d280"}], "security_groups": [{"name": "tempest-securitygroup--206254291"}], "key_name": "tempest-keypair-1846209742", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:37:46.731902 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.network.neutron [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] validate_networks() for [('d83dab97-84dd-4ed1-960a-d73699e6d280', None, None, None, None, None)] {{(pid=116182) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 17 21:37:47.331533 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Flavor limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 17 21:37:47.331955 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Image limits 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 17 21:37:47.332446 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Flavor pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 17 21:37:47.332851 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Image pref 0:0:0 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 17 21:37:47.333525 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.virt.hardware [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 17 21:37:47.342163 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:47.342609 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:47.343412 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:47.343845 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:47.359980 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Getting quotas for project 8b4ad2da51ac441986f9af1c8c6a30c1. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 17 21:37:47.363870 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.quota [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Getting quotas for user 844c17f7d55f4d66893be8af81851331 and project 8b4ad2da51ac441986f9af1c8c6a30c1. Resources: {'ram', 'instances', 'cores'} {{(pid=116182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 17 21:37:47.375192 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Going to run 1 instances... {{(pid=116182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 17 21:37:47.377478 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='10ea5b4b-b70d-4716-a51b-01169c4ad887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 17 21:37:47.425035 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3b86e978-04cf-4885-91bd-a1836be56202 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.806912 Jan 17 21:37:47.425674 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 695/1383] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jan 17 21:37:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 17 21:37:47.436291 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5a5bbce8-c0e5-48e8-95c2-8d84a2b29b6c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:47.437027 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5a5bbce8-c0e5-48e8-95c2-8d84a2b29b6c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:47.490289 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-5a5bbce8-c0e5-48e8-95c2-8d84a2b29b6c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:37:47.497434 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5a5bbce8-c0e5-48e8-95c2-8d84a2b29b6c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 200 len: 1238 microversion: 2.1 time: 0.065153 Jan 17 21:37:47.497994 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 689/1384] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:37:47 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:37:48.516753 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-34657242-7c1b-4e5d-8384-fb89087adfa1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:48.517453 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-34657242-7c1b-4e5d-8384-fb89087adfa1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:48.523908 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-34657242-7c1b-4e5d-8384-fb89087adfa1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:48.524366 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-34657242-7c1b-4e5d-8384-fb89087adfa1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:48.525194 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-34657242-7c1b-4e5d-8384-fb89087adfa1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:48.525643 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-34657242-7c1b-4e5d-8384-fb89087adfa1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:48.586400 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-34657242-7c1b-4e5d-8384-fb89087adfa1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:37:48.593805 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-34657242-7c1b-4e5d-8384-fb89087adfa1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 200 len: 1296 microversion: 2.1 time: 0.081985 Jan 17 21:37:48.594383 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 696/1385] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:37:48 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 1296 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 17 21:37:49.612538 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-86a05f43-e663-4433-996d-e854938681b4 req-e67d9345-f1c5-4926-bfeb-9e54ca2a59f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdf5db38-0987-41cc-b468-2267aac17deb", "tag": "84638381-a10a-423e-ae50-4f652a10d4f3"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:37:49.613064 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d0405260-38fb-4431-99f7-2afe6f5225a9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:49.613563 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d0405260-38fb-4431-99f7-2afe6f5225a9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:49.614145 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:37:49.614145 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:37:49.622141 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0405260-38fb-4431-99f7-2afe6f5225a9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:49.622924 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0405260-38fb-4431-99f7-2afe6f5225a9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:49.629822 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-86a05f43-e663-4433-996d-e854938681b4 req-e67d9345-f1c5-4926-bfeb-9e54ca2a59f4 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:49.630656 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-86a05f43-e663-4433-996d-e854938681b4 req-e67d9345-f1c5-4926-bfeb-9e54ca2a59f4 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:49.636700 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0405260-38fb-4431-99f7-2afe6f5225a9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:49.639262 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0405260-38fb-4431-99f7-2afe6f5225a9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:49.653156 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-86a05f43-e663-4433-996d-e854938681b4 req-e67d9345-f1c5-4926-bfeb-9e54ca2a59f4 service nova] Creating event network-changed:84638381-a10a-423e-ae50-4f652a10d4f3 for instance fdf5db38-0987-41cc-b468-2267aac17deb on hv-cinder-82489 Jan 17 21:37:49.658641 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-86a05f43-e663-4433-996d-e854938681b4 req-e67d9345-f1c5-4926-bfeb-9e54ca2a59f4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052459 Jan 17 21:37:49.659553 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 690/1386] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:37:49.795813 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d0405260-38fb-4431-99f7-2afe6f5225a9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:37:49.804240 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d0405260-38fb-4431-99f7-2afe6f5225a9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 200 len: 1363 microversion: 2.1 time: 0.197428 Jan 17 21:37:49.804834 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 697/1387] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:37:49 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:37:50.821866 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-6c702e38-d0aa-48ba-adeb-b90e7a71644e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:50.822488 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-6c702e38-d0aa-48ba-adeb-b90e7a71644e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:50.828662 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6c702e38-d0aa-48ba-adeb-b90e7a71644e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:50.829118 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6c702e38-d0aa-48ba-adeb-b90e7a71644e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:50.829910 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6c702e38-d0aa-48ba-adeb-b90e7a71644e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:50.830353 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-6c702e38-d0aa-48ba-adeb-b90e7a71644e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:50.962560 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-6c702e38-d0aa-48ba-adeb-b90e7a71644e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:37:50.969812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-6c702e38-d0aa-48ba-adeb-b90e7a71644e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 200 len: 1363 microversion: 2.1 time: 0.152430 Jan 17 21:37:50.970372 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 691/1388] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:37:50 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:37:51.986886 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ceadd2b5-dc83-4840-a57b-4bd07d4d06aa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:51.987498 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ceadd2b5-dc83-4840-a57b-4bd07d4d06aa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:51.994022 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ceadd2b5-dc83-4840-a57b-4bd07d4d06aa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:51.994478 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ceadd2b5-dc83-4840-a57b-4bd07d4d06aa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:51.995264 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ceadd2b5-dc83-4840-a57b-4bd07d4d06aa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:51.995706 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ceadd2b5-dc83-4840-a57b-4bd07d4d06aa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:52.129950 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-ceadd2b5-dc83-4840-a57b-4bd07d4d06aa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:37:52.137781 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ceadd2b5-dc83-4840-a57b-4bd07d4d06aa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 200 len: 1363 microversion: 2.1 time: 0.154586 Jan 17 21:37:52.138335 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 698/1389] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:37:51 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:37:53.155159 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-515034e1-4593-4def-87c0-ac51cc8ad357 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:53.155901 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-515034e1-4593-4def-87c0-ac51cc8ad357 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:53.163566 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-515034e1-4593-4def-87c0-ac51cc8ad357 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:53.164180 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-515034e1-4593-4def-87c0-ac51cc8ad357 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:53.165481 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-515034e1-4593-4def-87c0-ac51cc8ad357 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:53.166004 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-515034e1-4593-4def-87c0-ac51cc8ad357 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:53.318143 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-515034e1-4593-4def-87c0-ac51cc8ad357 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:37:53.325554 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-515034e1-4593-4def-87c0-ac51cc8ad357 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 200 len: 1363 microversion: 2.1 time: 0.175335 Jan 17 21:37:53.326343 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 692/1390] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:37:53 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:37:54.342790 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-9c3f3ef9-9f8c-43fc-ad4b-b26c14fcc33e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:54.343372 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-9c3f3ef9-9f8c-43fc-ad4b-b26c14fcc33e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:54.350502 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9c3f3ef9-9f8c-43fc-ad4b-b26c14fcc33e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:54.350960 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9c3f3ef9-9f8c-43fc-ad4b-b26c14fcc33e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:54.351770 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9c3f3ef9-9f8c-43fc-ad4b-b26c14fcc33e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:54.352214 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-9c3f3ef9-9f8c-43fc-ad4b-b26c14fcc33e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:54.485728 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-9c3f3ef9-9f8c-43fc-ad4b-b26c14fcc33e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:37:54.493703 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-9c3f3ef9-9f8c-43fc-ad4b-b26c14fcc33e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 200 len: 1363 microversion: 2.1 time: 0.154714 Jan 17 21:37:54.494276 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 699/1391] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:37:54 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:37:55.426739 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-35f29363-3ca1-4aa6-b5d3-3d900ae30337 req-c2bdbe3a-b212-46a1-b99e-36fac0eeded4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf5db38-0987-41cc-b468-2267aac17deb", "name": "network-vif-plugged", "status": "completed", "tag": "84638381-a10a-423e-ae50-4f652a10d4f3"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:37:55.428337 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:37:55.428337 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:37:55.436082 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-35f29363-3ca1-4aa6-b5d3-3d900ae30337 req-c2bdbe3a-b212-46a1-b99e-36fac0eeded4 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:55.436609 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-35f29363-3ca1-4aa6-b5d3-3d900ae30337 req-c2bdbe3a-b212-46a1-b99e-36fac0eeded4 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:55.447688 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-35f29363-3ca1-4aa6-b5d3-3d900ae30337 req-c2bdbe3a-b212-46a1-b99e-36fac0eeded4 service nova] Creating event network-vif-plugged:84638381-a10a-423e-ae50-4f652a10d4f3 for instance fdf5db38-0987-41cc-b468-2267aac17deb on hv-cinder-82489 Jan 17 21:37:55.452573 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-35f29363-3ca1-4aa6-b5d3-3d900ae30337 req-c2bdbe3a-b212-46a1-b99e-36fac0eeded4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029553 Jan 17 21:37:55.453164 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 693/1392] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:37:55.510868 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-cee31784-af98-41f3-ab04-ddaf0ee3cbd1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:55.511517 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-cee31784-af98-41f3-ab04-ddaf0ee3cbd1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:55.518113 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cee31784-af98-41f3-ab04-ddaf0ee3cbd1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:55.518567 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cee31784-af98-41f3-ab04-ddaf0ee3cbd1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:55.519355 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cee31784-af98-41f3-ab04-ddaf0ee3cbd1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:55.519789 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-cee31784-af98-41f3-ab04-ddaf0ee3cbd1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:55.659986 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-cee31784-af98-41f3-ab04-ddaf0ee3cbd1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:37:55.667408 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-cee31784-af98-41f3-ab04-ddaf0ee3cbd1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 200 len: 1363 microversion: 2.1 time: 0.160215 Jan 17 21:37:55.667987 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 700/1393] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:37:55 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:37:56.684882 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d4c82212-5fd4-45a9-9c62-ef9489d964b5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:56.685585 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d4c82212-5fd4-45a9-9c62-ef9489d964b5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:56.692006 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4c82212-5fd4-45a9-9c62-ef9489d964b5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:56.692487 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4c82212-5fd4-45a9-9c62-ef9489d964b5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:56.693278 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4c82212-5fd4-45a9-9c62-ef9489d964b5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:56.693721 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d4c82212-5fd4-45a9-9c62-ef9489d964b5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:56.826827 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-d4c82212-5fd4-45a9-9c62-ef9489d964b5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:37:56.834909 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d4c82212-5fd4-45a9-9c62-ef9489d964b5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 200 len: 1363 microversion: 2.1 time: 0.153962 Jan 17 21:37:56.835468 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 694/1394] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:37:56 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:37:57.852199 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d23d48c7-cc9b-4432-9c1c-51d54dff044a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:57.852828 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d23d48c7-cc9b-4432-9c1c-51d54dff044a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:57.859063 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d23d48c7-cc9b-4432-9c1c-51d54dff044a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:57.859511 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d23d48c7-cc9b-4432-9c1c-51d54dff044a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:57.860284 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d23d48c7-cc9b-4432-9c1c-51d54dff044a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:57.860752 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d23d48c7-cc9b-4432-9c1c-51d54dff044a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:57.992331 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-d23d48c7-cc9b-4432-9c1c-51d54dff044a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:37:57.999662 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d23d48c7-cc9b-4432-9c1c-51d54dff044a tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 200 len: 1550 microversion: 2.1 time: 0.151717 Jan 17 21:37:58.000259 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 701/1395] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:37:57 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:37:58.015592 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-cf1a72d4-7dfa-4fa5-8118-7c5ecf78b7c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:37:58.016075 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-cf1a72d4-7dfa-4fa5-8118-7c5ecf78b7c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:58.022260 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cf1a72d4-7dfa-4fa5-8118-7c5ecf78b7c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:58.022717 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cf1a72d4-7dfa-4fa5-8118-7c5ecf78b7c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:58.023498 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cf1a72d4-7dfa-4fa5-8118-7c5ecf78b7c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:58.024025 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-cf1a72d4-7dfa-4fa5-8118-7c5ecf78b7c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:58.106398 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-cf1a72d4-7dfa-4fa5-8118-7c5ecf78b7c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094410 Jan 17 21:37:58.106990 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 695/1396] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jan 17 21:37:58 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:37:59.054058 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-863303c2-41e5-45bf-84ae-9d005f8a401d req-ffadb925-4999-48fe-80f7-fa6078e5148e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdf5db38-0987-41cc-b468-2267aac17deb", "tag": "84638381-a10a-423e-ae50-4f652a10d4f3"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:37:59.055220 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1d791ea2-309d-4de3-a189-e598e801a7a2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:37:59.055630 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:37:59.055630 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:37:59.056286 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1d791ea2-309d-4de3-a189-e598e801a7a2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:37:59.062529 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d791ea2-309d-4de3-a189-e598e801a7a2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:59.062768 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-863303c2-41e5-45bf-84ae-9d005f8a401d req-ffadb925-4999-48fe-80f7-fa6078e5148e service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:59.062984 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d791ea2-309d-4de3-a189-e598e801a7a2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:59.063582 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-863303c2-41e5-45bf-84ae-9d005f8a401d req-ffadb925-4999-48fe-80f7-fa6078e5148e service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:59.063780 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d791ea2-309d-4de3-a189-e598e801a7a2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:37:59.064225 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1d791ea2-309d-4de3-a189-e598e801a7a2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:37:59.076460 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-863303c2-41e5-45bf-84ae-9d005f8a401d req-ffadb925-4999-48fe-80f7-fa6078e5148e service nova] Creating event network-changed:84638381-a10a-423e-ae50-4f652a10d4f3 for instance fdf5db38-0987-41cc-b468-2267aac17deb on hv-cinder-82489 Jan 17 21:37:59.081631 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-863303c2-41e5-45bf-84ae-9d005f8a401d req-ffadb925-4999-48fe-80f7-fa6078e5148e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031994 Jan 17 21:37:59.082627 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 696/1397] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:37:59.122553 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1d791ea2-309d-4de3-a189-e598e801a7a2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 14 microversion: 2.1 time: 0.077295 Jan 17 21:37:59.123556 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 702/1398] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:37:59 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:38:00.134898 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3f2259f5-0aab-4178-8cd0-68bd36d3b7e2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:00.135891 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3f2259f5-0aab-4178-8cd0-68bd36d3b7e2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:00.142472 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3f2259f5-0aab-4178-8cd0-68bd36d3b7e2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:00.142927 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3f2259f5-0aab-4178-8cd0-68bd36d3b7e2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:00.143777 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3f2259f5-0aab-4178-8cd0-68bd36d3b7e2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:00.144425 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3f2259f5-0aab-4178-8cd0-68bd36d3b7e2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:00.199533 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3f2259f5-0aab-4178-8cd0-68bd36d3b7e2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 14 microversion: 2.1 time: 0.069395 Jan 17 21:38:00.200096 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 697/1399] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:00 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:38:01.211292 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a5411700-72b7-4309-bbfa-13bbb7d82587 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:01.212293 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a5411700-72b7-4309-bbfa-13bbb7d82587 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:01.219279 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a5411700-72b7-4309-bbfa-13bbb7d82587 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:01.219741 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a5411700-72b7-4309-bbfa-13bbb7d82587 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:01.220576 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a5411700-72b7-4309-bbfa-13bbb7d82587 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:01.221025 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a5411700-72b7-4309-bbfa-13bbb7d82587 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:01.276897 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a5411700-72b7-4309-bbfa-13bbb7d82587 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 14 microversion: 2.1 time: 0.069752 Jan 17 21:38:01.277427 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 703/1400] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:01 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:38:02.287447 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-71e3e6f7-c009-4e15-96a6-938fd52b95c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:02.288409 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-71e3e6f7-c009-4e15-96a6-938fd52b95c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:02.295295 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-71e3e6f7-c009-4e15-96a6-938fd52b95c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:02.295759 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-71e3e6f7-c009-4e15-96a6-938fd52b95c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:02.296586 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-71e3e6f7-c009-4e15-96a6-938fd52b95c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:02.297036 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-71e3e6f7-c009-4e15-96a6-938fd52b95c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:02.354238 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-71e3e6f7-c009-4e15-96a6-938fd52b95c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 14 microversion: 2.1 time: 0.070704 Jan 17 21:38:02.354901 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 698/1401] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:02 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:38:03.366388 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-e210e645-7923-42a6-a3c2-ba05e3c19ae8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:03.367395 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-e210e645-7923-42a6-a3c2-ba05e3c19ae8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:03.374293 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e210e645-7923-42a6-a3c2-ba05e3c19ae8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:03.374752 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e210e645-7923-42a6-a3c2-ba05e3c19ae8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:03.375546 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e210e645-7923-42a6-a3c2-ba05e3c19ae8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:03.375992 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-e210e645-7923-42a6-a3c2-ba05e3c19ae8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:03.431368 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-e210e645-7923-42a6-a3c2-ba05e3c19ae8 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 14 microversion: 2.1 time: 0.069532 Jan 17 21:38:03.432003 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 704/1402] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:03 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:38:04.443358 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-ef580085-6301-441b-9d3a-8a098d7ca09b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:04.444359 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-ef580085-6301-441b-9d3a-8a098d7ca09b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:04.452184 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ef580085-6301-441b-9d3a-8a098d7ca09b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:04.452665 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ef580085-6301-441b-9d3a-8a098d7ca09b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:04.453474 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ef580085-6301-441b-9d3a-8a098d7ca09b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:04.453917 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-ef580085-6301-441b-9d3a-8a098d7ca09b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:04.510450 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-ef580085-6301-441b-9d3a-8a098d7ca09b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 14 microversion: 2.1 time: 0.070928 Jan 17 21:38:04.511080 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 699/1403] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:04 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:38:05.522547 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4639cf76-28d5-45dd-bafd-51ef61c8baaa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:05.523589 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4639cf76-28d5-45dd-bafd-51ef61c8baaa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:05.530576 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4639cf76-28d5-45dd-bafd-51ef61c8baaa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:05.531038 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4639cf76-28d5-45dd-bafd-51ef61c8baaa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:05.531830 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4639cf76-28d5-45dd-bafd-51ef61c8baaa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:05.532276 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4639cf76-28d5-45dd-bafd-51ef61c8baaa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:05.596221 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4639cf76-28d5-45dd-bafd-51ef61c8baaa tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 14 microversion: 2.1 time: 0.078149 Jan 17 21:38:05.596878 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 705/1404] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:05 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:38:06.608060 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-16575e1d-67fa-41ef-88e6-47ea3f2cbfcb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:06.609157 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-16575e1d-67fa-41ef-88e6-47ea3f2cbfcb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:06.616620 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-16575e1d-67fa-41ef-88e6-47ea3f2cbfcb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:06.617069 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-16575e1d-67fa-41ef-88e6-47ea3f2cbfcb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:06.617854 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-16575e1d-67fa-41ef-88e6-47ea3f2cbfcb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:06.618288 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-16575e1d-67fa-41ef-88e6-47ea3f2cbfcb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:06.676493 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-16575e1d-67fa-41ef-88e6-47ea3f2cbfcb tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 14 microversion: 2.1 time: 0.072141 Jan 17 21:38:06.677145 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 700/1405] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:06 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:38:07.689054 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6fb2173d-8391-4686-aeea-5408c2805573 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:07.690075 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6fb2173d-8391-4686-aeea-5408c2805573 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:07.697776 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6fb2173d-8391-4686-aeea-5408c2805573 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:07.698237 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6fb2173d-8391-4686-aeea-5408c2805573 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:07.699059 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6fb2173d-8391-4686-aeea-5408c2805573 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:07.699503 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6fb2173d-8391-4686-aeea-5408c2805573 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:07.758450 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6fb2173d-8391-4686-aeea-5408c2805573 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 14 microversion: 2.1 time: 0.073300 Jan 17 21:38:07.759224 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 706/1406] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:07 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:38:08.770418 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2b544efd-1606-44d9-8cfa-f5846d02adf7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:08.771935 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2b544efd-1606-44d9-8cfa-f5846d02adf7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:08.779101 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2b544efd-1606-44d9-8cfa-f5846d02adf7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:08.779559 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2b544efd-1606-44d9-8cfa-f5846d02adf7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:08.780356 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2b544efd-1606-44d9-8cfa-f5846d02adf7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:08.780819 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2b544efd-1606-44d9-8cfa-f5846d02adf7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:08.859092 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2b544efd-1606-44d9-8cfa-f5846d02adf7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 6451 microversion: 2.1 time: 0.092662 Jan 17 21:38:08.859721 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 701/1407] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:08 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 6451 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:38:09.871575 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-524cb3eb-f426-4b48-a8e6-8aa8c9e3e35d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:09.872641 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-524cb3eb-f426-4b48-a8e6-8aa8c9e3e35d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:09.879823 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-524cb3eb-f426-4b48-a8e6-8aa8c9e3e35d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:09.880284 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-524cb3eb-f426-4b48-a8e6-8aa8c9e3e35d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:09.881118 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-524cb3eb-f426-4b48-a8e6-8aa8c9e3e35d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:09.881562 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-524cb3eb-f426-4b48-a8e6-8aa8c9e3e35d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:09.949345 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-524cb3eb-f426-4b48-a8e6-8aa8c9e3e35d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 15025 microversion: 2.1 time: 0.081753 Jan 17 21:38:09.950037 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 707/1408] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:09 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 15025 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:10.961604 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4d9272e7-851d-4516-8263-91e8de4e8ef3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:10.962521 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4d9272e7-851d-4516-8263-91e8de4e8ef3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:10.969527 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4d9272e7-851d-4516-8263-91e8de4e8ef3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:10.969987 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4d9272e7-851d-4516-8263-91e8de4e8ef3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:10.970780 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4d9272e7-851d-4516-8263-91e8de4e8ef3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:10.971225 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4d9272e7-851d-4516-8263-91e8de4e8ef3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:11.050519 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4d9272e7-851d-4516-8263-91e8de4e8ef3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 18608 microversion: 2.1 time: 0.093004 Jan 17 21:38:11.051224 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 702/1409] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:10 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 18608 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:12.063285 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1e10b9cf-4d80-4afc-bf61-0a551f7f7ace tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:12.064293 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1e10b9cf-4d80-4afc-bf61-0a551f7f7ace tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:12.072046 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1e10b9cf-4d80-4afc-bf61-0a551f7f7ace tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:12.072545 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1e10b9cf-4d80-4afc-bf61-0a551f7f7ace tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:12.073355 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1e10b9cf-4d80-4afc-bf61-0a551f7f7ace tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:12.073832 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1e10b9cf-4d80-4afc-bf61-0a551f7f7ace tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:12.151066 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1e10b9cf-4d80-4afc-bf61-0a551f7f7ace tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 20074 microversion: 2.1 time: 0.091670 Jan 17 21:38:12.151963 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 708/1410] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:12 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 20074 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:13.163661 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f0789210-24cb-4dac-8581-5afc972e671b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:13.164769 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f0789210-24cb-4dac-8581-5afc972e671b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:13.171841 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f0789210-24cb-4dac-8581-5afc972e671b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:13.172286 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f0789210-24cb-4dac-8581-5afc972e671b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:13.173110 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f0789210-24cb-4dac-8581-5afc972e671b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:13.173546 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f0789210-24cb-4dac-8581-5afc972e671b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:13.241123 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f0789210-24cb-4dac-8581-5afc972e671b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 22721 microversion: 2.1 time: 0.081758 Jan 17 21:38:13.241705 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 703/1411] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:13 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 22721 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:14.252525 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d0d86aa4-d0cb-4152-ae77-2882b2ed5f0f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:14.253433 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d0d86aa4-d0cb-4152-ae77-2882b2ed5f0f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:14.260228 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0d86aa4-d0cb-4152-ae77-2882b2ed5f0f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:14.260701 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0d86aa4-d0cb-4152-ae77-2882b2ed5f0f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:14.261474 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0d86aa4-d0cb-4152-ae77-2882b2ed5f0f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:14.261940 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0d86aa4-d0cb-4152-ae77-2882b2ed5f0f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:14.331015 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d0d86aa4-d0cb-4152-ae77-2882b2ed5f0f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 23913 microversion: 2.1 time: 0.082520 Jan 17 21:38:14.331629 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 709/1412] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:14 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 23913 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:15.342715 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8f749d37-7741-4dd0-9f47-ab378686014d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:15.343624 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8f749d37-7741-4dd0-9f47-ab378686014d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:15.350529 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8f749d37-7741-4dd0-9f47-ab378686014d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:15.350985 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8f749d37-7741-4dd0-9f47-ab378686014d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:15.351787 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8f749d37-7741-4dd0-9f47-ab378686014d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:15.352222 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8f749d37-7741-4dd0-9f47-ab378686014d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:15.429343 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8f749d37-7741-4dd0-9f47-ab378686014d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 25646 microversion: 2.1 time: 0.090601 Jan 17 21:38:15.430003 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 704/1413] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:15 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 25646 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:16.442715 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4488e909-2d84-47be-9c55-fbbb8b7fb7f1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:16.444538 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4488e909-2d84-47be-9c55-fbbb8b7fb7f1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:16.453244 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4488e909-2d84-47be-9c55-fbbb8b7fb7f1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:16.453698 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4488e909-2d84-47be-9c55-fbbb8b7fb7f1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:16.454583 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4488e909-2d84-47be-9c55-fbbb8b7fb7f1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:16.455019 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4488e909-2d84-47be-9c55-fbbb8b7fb7f1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:16.535323 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4488e909-2d84-47be-9c55-fbbb8b7fb7f1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 27032 microversion: 2.1 time: 0.097523 Jan 17 21:38:16.536000 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 710/1414] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:16 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 27032 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:17.548079 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-bf0e6208-eaea-454c-bd4c-ed991751b542 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:17.549097 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-bf0e6208-eaea-454c-bd4c-ed991751b542 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:17.556561 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bf0e6208-eaea-454c-bd4c-ed991751b542 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:17.557019 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bf0e6208-eaea-454c-bd4c-ed991751b542 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:17.557805 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bf0e6208-eaea-454c-bd4c-ed991751b542 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:17.558252 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-bf0e6208-eaea-454c-bd4c-ed991751b542 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:17.630424 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-bf0e6208-eaea-454c-bd4c-ed991751b542 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 27774 microversion: 2.1 time: 0.086294 Jan 17 21:38:17.631402 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 705/1415] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:17 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 27774 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:18.642554 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-4f0d029b-7965-45b8-bb74-32a6597ae445 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:18.643555 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-4f0d029b-7965-45b8-bb74-32a6597ae445 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:18.650432 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4f0d029b-7965-45b8-bb74-32a6597ae445 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:18.650887 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4f0d029b-7965-45b8-bb74-32a6597ae445 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:18.651670 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4f0d029b-7965-45b8-bb74-32a6597ae445 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:18.652111 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-4f0d029b-7965-45b8-bb74-32a6597ae445 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:18.723938 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-4f0d029b-7965-45b8-bb74-32a6597ae445 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28199 microversion: 2.1 time: 0.085222 Jan 17 21:38:18.725111 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 711/1416] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:18 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28199 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:19.735641 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-375bb209-fd45-4160-ae22-ba037fba6b47 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:19.736699 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-375bb209-fd45-4160-ae22-ba037fba6b47 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:19.743567 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-375bb209-fd45-4160-ae22-ba037fba6b47 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:19.744029 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-375bb209-fd45-4160-ae22-ba037fba6b47 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:19.744852 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-375bb209-fd45-4160-ae22-ba037fba6b47 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:19.745297 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-375bb209-fd45-4160-ae22-ba037fba6b47 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:19.805318 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-375bb209-fd45-4160-ae22-ba037fba6b47 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28199 microversion: 2.1 time: 0.073283 Jan 17 21:38:19.806006 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 706/1417] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:19 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:20.817406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ca253da4-3c86-4d6c-87bc-d1b05913dad4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:20.818451 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ca253da4-3c86-4d6c-87bc-d1b05913dad4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:20.826201 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca253da4-3c86-4d6c-87bc-d1b05913dad4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:20.826668 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca253da4-3c86-4d6c-87bc-d1b05913dad4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:20.827668 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca253da4-3c86-4d6c-87bc-d1b05913dad4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:20.828221 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ca253da4-3c86-4d6c-87bc-d1b05913dad4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:20.889233 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ca253da4-3c86-4d6c-87bc-d1b05913dad4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28199 microversion: 2.1 time: 0.075583 Jan 17 21:38:20.889768 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 712/1418] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:20 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28199 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:21.901801 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1e5dc890-ed59-4760-b811-675b3787e0a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:21.902801 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1e5dc890-ed59-4760-b811-675b3787e0a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:21.909685 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1e5dc890-ed59-4760-b811-675b3787e0a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:21.910143 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1e5dc890-ed59-4760-b811-675b3787e0a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:21.910933 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1e5dc890-ed59-4760-b811-675b3787e0a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:21.911381 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1e5dc890-ed59-4760-b811-675b3787e0a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:21.981062 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1e5dc890-ed59-4760-b811-675b3787e0a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28199 microversion: 2.1 time: 0.083063 Jan 17 21:38:21.982209 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 707/1419] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:21 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28199 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:23.045139 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a3caf797-3d7a-48fb-8b4b-326b391e7377 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:23.046192 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a3caf797-3d7a-48fb-8b4b-326b391e7377 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:23.053526 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a3caf797-3d7a-48fb-8b4b-326b391e7377 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:23.053981 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a3caf797-3d7a-48fb-8b4b-326b391e7377 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:23.054776 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a3caf797-3d7a-48fb-8b4b-326b391e7377 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:23.055223 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a3caf797-3d7a-48fb-8b4b-326b391e7377 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:23.113014 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a3caf797-3d7a-48fb-8b4b-326b391e7377 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28199 microversion: 2.1 time: 0.123581 Jan 17 21:38:23.113661 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 713/1420] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:22 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28199 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:24.126050 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-1a7bf946-9099-469b-b9ee-d1a3a6493b1e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:24.127061 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-1a7bf946-9099-469b-b9ee-d1a3a6493b1e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:24.134455 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1a7bf946-9099-469b-b9ee-d1a3a6493b1e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:24.134907 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1a7bf946-9099-469b-b9ee-d1a3a6493b1e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:24.135692 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1a7bf946-9099-469b-b9ee-d1a3a6493b1e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:24.136136 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-1a7bf946-9099-469b-b9ee-d1a3a6493b1e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:24.193218 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-1a7bf946-9099-469b-b9ee-d1a3a6493b1e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28199 microversion: 2.1 time: 0.071153 Jan 17 21:38:24.193847 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 708/1421] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:24 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:25.205967 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-957742bf-8a00-4b44-97cd-b9795d218061 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:25.206890 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-957742bf-8a00-4b44-97cd-b9795d218061 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:25.214636 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-957742bf-8a00-4b44-97cd-b9795d218061 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:25.215102 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-957742bf-8a00-4b44-97cd-b9795d218061 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:25.215942 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-957742bf-8a00-4b44-97cd-b9795d218061 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:25.216338 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-957742bf-8a00-4b44-97cd-b9795d218061 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:25.281278 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-957742bf-8a00-4b44-97cd-b9795d218061 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28199 microversion: 2.1 time: 0.079220 Jan 17 21:38:25.281848 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 714/1422] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:25 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:26.293227 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d444feb8-62b2-42cb-abdb-1e08b242f70b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:26.294133 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d444feb8-62b2-42cb-abdb-1e08b242f70b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:26.300901 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d444feb8-62b2-42cb-abdb-1e08b242f70b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:26.301350 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d444feb8-62b2-42cb-abdb-1e08b242f70b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:26.302124 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d444feb8-62b2-42cb-abdb-1e08b242f70b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:26.302556 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d444feb8-62b2-42cb-abdb-1e08b242f70b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:26.366111 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d444feb8-62b2-42cb-abdb-1e08b242f70b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28199 microversion: 2.1 time: 0.076847 Jan 17 21:38:26.366751 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 709/1423] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:26 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28199 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:27.377887 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-1203c7a8-0921-4927-957b-252203e16e74 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:27.378883 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-1203c7a8-0921-4927-957b-252203e16e74 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:27.386351 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1203c7a8-0921-4927-957b-252203e16e74 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:27.386806 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1203c7a8-0921-4927-957b-252203e16e74 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:27.387590 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1203c7a8-0921-4927-957b-252203e16e74 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:27.388027 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-1203c7a8-0921-4927-957b-252203e16e74 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:27.461301 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-1203c7a8-0921-4927-957b-252203e16e74 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28199 microversion: 2.1 time: 0.087191 Jan 17 21:38:27.461991 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 715/1424] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:27 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28199 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:28.474616 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-32befc17-b4bf-4bc6-86e0-6386d7c00768 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:28.475610 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-32befc17-b4bf-4bc6-86e0-6386d7c00768 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:28.482527 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-32befc17-b4bf-4bc6-86e0-6386d7c00768 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:28.482992 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-32befc17-b4bf-4bc6-86e0-6386d7c00768 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:28.483774 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-32befc17-b4bf-4bc6-86e0-6386d7c00768 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:28.484220 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-32befc17-b4bf-4bc6-86e0-6386d7c00768 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:28.558717 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-32befc17-b4bf-4bc6-86e0-6386d7c00768 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28199 microversion: 2.1 time: 0.087961 Jan 17 21:38:28.559378 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 710/1425] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:28 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:29.570804 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6153f673-f57b-4e5f-8d9f-656111ece093 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:29.572482 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6153f673-f57b-4e5f-8d9f-656111ece093 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:29.579318 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6153f673-f57b-4e5f-8d9f-656111ece093 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:29.579775 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6153f673-f57b-4e5f-8d9f-656111ece093 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:29.580613 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6153f673-f57b-4e5f-8d9f-656111ece093 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:29.581061 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6153f673-f57b-4e5f-8d9f-656111ece093 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:29.638608 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6153f673-f57b-4e5f-8d9f-656111ece093 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28199 microversion: 2.1 time: 0.071704 Jan 17 21:38:29.639236 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 716/1426] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:29 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:30.650883 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d0a8e0ba-c591-452d-af0b-88447ee1d116 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:30.651877 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d0a8e0ba-c591-452d-af0b-88447ee1d116 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:30.658927 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d0a8e0ba-c591-452d-af0b-88447ee1d116 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:30.659382 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d0a8e0ba-c591-452d-af0b-88447ee1d116 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:30.660175 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d0a8e0ba-c591-452d-af0b-88447ee1d116 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:30.660659 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d0a8e0ba-c591-452d-af0b-88447ee1d116 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:30.718481 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d0a8e0ba-c591-452d-af0b-88447ee1d116 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28199 microversion: 2.1 time: 0.071460 Jan 17 21:38:30.719155 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 711/1427] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:30 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:31.731199 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-63ccefe6-0440-41c9-a1cb-2f2736a0de7e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:31.732514 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-63ccefe6-0440-41c9-a1cb-2f2736a0de7e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:31.739406 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63ccefe6-0440-41c9-a1cb-2f2736a0de7e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:31.739863 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63ccefe6-0440-41c9-a1cb-2f2736a0de7e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:31.740686 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63ccefe6-0440-41c9-a1cb-2f2736a0de7e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:31.741135 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-63ccefe6-0440-41c9-a1cb-2f2736a0de7e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:31.817738 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-63ccefe6-0440-41c9-a1cb-2f2736a0de7e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28490 microversion: 2.1 time: 0.090645 Jan 17 21:38:31.818385 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 717/1428] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:31 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28490 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:38:32.830734 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-97f0348a-d6bf-4209-900f-aa214929ecbe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:32.831788 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-97f0348a-d6bf-4209-900f-aa214929ecbe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:32.839021 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-97f0348a-d6bf-4209-900f-aa214929ecbe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:32.839479 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-97f0348a-d6bf-4209-900f-aa214929ecbe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:32.840278 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-97f0348a-d6bf-4209-900f-aa214929ecbe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:32.840758 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-97f0348a-d6bf-4209-900f-aa214929ecbe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:32.897190 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-97f0348a-d6bf-4209-900f-aa214929ecbe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28490 microversion: 2.1 time: 0.070333 Jan 17 21:38:32.897740 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 712/1429] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:32 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28490 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:38:33.909364 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-91eab0a7-6464-43b2-bc49-e01e0f8620ed tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:33.910361 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-91eab0a7-6464-43b2-bc49-e01e0f8620ed tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:33.917472 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-91eab0a7-6464-43b2-bc49-e01e0f8620ed tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:33.917927 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-91eab0a7-6464-43b2-bc49-e01e0f8620ed tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:33.918715 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-91eab0a7-6464-43b2-bc49-e01e0f8620ed tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:33.919156 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-91eab0a7-6464-43b2-bc49-e01e0f8620ed tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:33.991105 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-91eab0a7-6464-43b2-bc49-e01e0f8620ed tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.085604 Jan 17 21:38:33.992446 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 718/1430] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:33 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:35.002478 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5570eac7-f7b6-4e73-88ca-ce4cb547bc3b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:35.003499 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5570eac7-f7b6-4e73-88ca-ce4cb547bc3b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:35.011401 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5570eac7-f7b6-4e73-88ca-ce4cb547bc3b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:35.011861 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5570eac7-f7b6-4e73-88ca-ce4cb547bc3b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:35.012691 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5570eac7-f7b6-4e73-88ca-ce4cb547bc3b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:35.013134 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5570eac7-f7b6-4e73-88ca-ce4cb547bc3b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:35.085995 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5570eac7-f7b6-4e73-88ca-ce4cb547bc3b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.087291 Jan 17 21:38:35.086652 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 713/1431] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:34 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:36.098740 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d0c5b29c-9093-47fd-a006-c61236dc11f9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:36.099748 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d0c5b29c-9093-47fd-a006-c61236dc11f9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:36.106655 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0c5b29c-9093-47fd-a006-c61236dc11f9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:36.107115 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0c5b29c-9093-47fd-a006-c61236dc11f9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:36.107903 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0c5b29c-9093-47fd-a006-c61236dc11f9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:36.108347 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d0c5b29c-9093-47fd-a006-c61236dc11f9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:36.175540 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d0c5b29c-9093-47fd-a006-c61236dc11f9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.080760 Jan 17 21:38:36.176189 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 719/1432] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:36 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:37.187588 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-2e7a5530-cee4-4be8-b945-f3af508bc858 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:37.188616 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-2e7a5530-cee4-4be8-b945-f3af508bc858 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:37.195454 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2e7a5530-cee4-4be8-b945-f3af508bc858 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:37.195981 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2e7a5530-cee4-4be8-b945-f3af508bc858 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:37.196801 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2e7a5530-cee4-4be8-b945-f3af508bc858 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:37.197243 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-2e7a5530-cee4-4be8-b945-f3af508bc858 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:37.261877 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-2e7a5530-cee4-4be8-b945-f3af508bc858 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.078140 Jan 17 21:38:37.262541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 714/1433] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:37 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:38.274659 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6645376a-930e-4149-b2c7-2f86581be45f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:38.275563 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6645376a-930e-4149-b2c7-2f86581be45f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:38.282353 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6645376a-930e-4149-b2c7-2f86581be45f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:38.282801 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6645376a-930e-4149-b2c7-2f86581be45f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:38.283570 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6645376a-930e-4149-b2c7-2f86581be45f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:38.284003 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6645376a-930e-4149-b2c7-2f86581be45f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:38.347448 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6645376a-930e-4149-b2c7-2f86581be45f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.077344 Jan 17 21:38:38.348110 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 720/1434] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:38 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:39.359950 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-74f810b4-6058-44b0-9154-28c6844fd25d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:39.360971 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-74f810b4-6058-44b0-9154-28c6844fd25d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:39.367772 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-74f810b4-6058-44b0-9154-28c6844fd25d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:39.368223 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-74f810b4-6058-44b0-9154-28c6844fd25d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:39.369539 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-74f810b4-6058-44b0-9154-28c6844fd25d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:39.369979 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-74f810b4-6058-44b0-9154-28c6844fd25d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:39.433729 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-74f810b4-6058-44b0-9154-28c6844fd25d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.077638 Jan 17 21:38:39.434377 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 715/1435] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:39 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:40.446380 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7865a807-cabc-4127-983c-891d169f90c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:40.447883 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7865a807-cabc-4127-983c-891d169f90c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:40.455028 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7865a807-cabc-4127-983c-891d169f90c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:40.455489 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7865a807-cabc-4127-983c-891d169f90c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:40.456351 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7865a807-cabc-4127-983c-891d169f90c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:40.456822 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7865a807-cabc-4127-983c-891d169f90c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:40.523434 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7865a807-cabc-4127-983c-891d169f90c9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.080988 Jan 17 21:38:40.524104 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 721/1436] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:40 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:41.537063 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-13c0d620-6fcb-4693-87e2-262efa1cf7f2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:41.538377 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-13c0d620-6fcb-4693-87e2-262efa1cf7f2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:41.546392 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-13c0d620-6fcb-4693-87e2-262efa1cf7f2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:41.546839 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-13c0d620-6fcb-4693-87e2-262efa1cf7f2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:41.547621 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-13c0d620-6fcb-4693-87e2-262efa1cf7f2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:41.548158 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-13c0d620-6fcb-4693-87e2-262efa1cf7f2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:41.606356 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-13c0d620-6fcb-4693-87e2-262efa1cf7f2 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.074020 Jan 17 21:38:41.607330 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 716/1437] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:41 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:42.618532 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8d759223-be87-408d-bd3e-0aaa3763a7e3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:42.620215 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8d759223-be87-408d-bd3e-0aaa3763a7e3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:42.627213 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8d759223-be87-408d-bd3e-0aaa3763a7e3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:42.628184 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8d759223-be87-408d-bd3e-0aaa3763a7e3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:42.628478 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8d759223-be87-408d-bd3e-0aaa3763a7e3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:42.628920 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8d759223-be87-408d-bd3e-0aaa3763a7e3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:42.696325 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8d759223-be87-408d-bd3e-0aaa3763a7e3 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.081666 Jan 17 21:38:42.697012 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 722/1438] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:42 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:43.708849 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-db0c1484-c6c0-47ee-9ad1-528e8391a199 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:43.709846 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-db0c1484-c6c0-47ee-9ad1-528e8391a199 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:43.717517 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-db0c1484-c6c0-47ee-9ad1-528e8391a199 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:43.717982 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-db0c1484-c6c0-47ee-9ad1-528e8391a199 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:43.718795 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-db0c1484-c6c0-47ee-9ad1-528e8391a199 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:43.719234 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-db0c1484-c6c0-47ee-9ad1-528e8391a199 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:43.779843 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-db0c1484-c6c0-47ee-9ad1-528e8391a199 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.075039 Jan 17 21:38:43.780441 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 717/1439] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:43 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:38:44.791803 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fba147ef-ee47-4cce-896f-fd29f2a3fb26 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:44.792905 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fba147ef-ee47-4cce-896f-fd29f2a3fb26 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:44.800026 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fba147ef-ee47-4cce-896f-fd29f2a3fb26 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:44.800503 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fba147ef-ee47-4cce-896f-fd29f2a3fb26 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:44.801298 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fba147ef-ee47-4cce-896f-fd29f2a3fb26 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:44.801733 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fba147ef-ee47-4cce-896f-fd29f2a3fb26 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:44.873865 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fba147ef-ee47-4cce-896f-fd29f2a3fb26 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.086012 Jan 17 21:38:44.874684 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 723/1440] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:44 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:45.886138 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-f263fa64-2d7d-4f1a-8d83-bdf8fa371974 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:45.887159 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-f263fa64-2d7d-4f1a-8d83-bdf8fa371974 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:45.894349 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f263fa64-2d7d-4f1a-8d83-bdf8fa371974 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:45.894803 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f263fa64-2d7d-4f1a-8d83-bdf8fa371974 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:45.895590 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f263fa64-2d7d-4f1a-8d83-bdf8fa371974 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:45.896023 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-f263fa64-2d7d-4f1a-8d83-bdf8fa371974 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:45.957583 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-f263fa64-2d7d-4f1a-8d83-bdf8fa371974 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.075270 Jan 17 21:38:45.959372 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 718/1441] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:45 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:46.970342 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a92775ba-8e74-4542-bc3c-29926f4e8604 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:46.971255 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a92775ba-8e74-4542-bc3c-29926f4e8604 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:46.978220 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a92775ba-8e74-4542-bc3c-29926f4e8604 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:46.978693 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a92775ba-8e74-4542-bc3c-29926f4e8604 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:46.979488 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a92775ba-8e74-4542-bc3c-29926f4e8604 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:46.979929 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a92775ba-8e74-4542-bc3c-29926f4e8604 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:47.038932 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a92775ba-8e74-4542-bc3c-29926f4e8604 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.072469 Jan 17 21:38:47.039603 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 724/1442] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:46 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:48.051258 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4e197204-e891-49c0-ad96-10f56779453f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:48.052249 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4e197204-e891-49c0-ad96-10f56779453f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:48.059183 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4e197204-e891-49c0-ad96-10f56779453f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:48.059635 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4e197204-e891-49c0-ad96-10f56779453f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:48.060442 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4e197204-e891-49c0-ad96-10f56779453f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:48.060891 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4e197204-e891-49c0-ad96-10f56779453f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:48.122779 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4e197204-e891-49c0-ad96-10f56779453f tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.075310 Jan 17 21:38:48.123437 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 719/1443] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:48 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:49.135164 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-67e62f02-59fd-4909-b9fc-404cf94a468d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:49.136178 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-67e62f02-59fd-4909-b9fc-404cf94a468d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:49.143270 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-67e62f02-59fd-4909-b9fc-404cf94a468d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:49.143731 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-67e62f02-59fd-4909-b9fc-404cf94a468d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:49.144571 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-67e62f02-59fd-4909-b9fc-404cf94a468d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:49.145020 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-67e62f02-59fd-4909-b9fc-404cf94a468d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:49.205618 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-67e62f02-59fd-4909-b9fc-404cf94a468d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.074327 Jan 17 21:38:49.206285 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 725/1444] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:49 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:50.218863 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5602d26f-310f-4534-aeab-1670f78b2540 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:50.219870 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5602d26f-310f-4534-aeab-1670f78b2540 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:50.226832 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5602d26f-310f-4534-aeab-1670f78b2540 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:50.227291 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5602d26f-310f-4534-aeab-1670f78b2540 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:50.228095 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5602d26f-310f-4534-aeab-1670f78b2540 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:50.228640 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5602d26f-310f-4534-aeab-1670f78b2540 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:50.290545 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5602d26f-310f-4534-aeab-1670f78b2540 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.075527 Jan 17 21:38:50.291155 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 720/1445] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:50 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:51.302791 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-ed706ebd-9669-44c4-975d-279d14fd0c75 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:51.303712 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-ed706ebd-9669-44c4-975d-279d14fd0c75 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:51.310948 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ed706ebd-9669-44c4-975d-279d14fd0c75 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:51.311400 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ed706ebd-9669-44c4-975d-279d14fd0c75 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:51.312198 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ed706ebd-9669-44c4-975d-279d14fd0c75 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:51.312681 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-ed706ebd-9669-44c4-975d-279d14fd0c75 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:51.382233 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-ed706ebd-9669-44c4-975d-279d14fd0c75 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.083389 Jan 17 21:38:51.382908 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 726/1446] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:51 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:52.395056 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8b086405-bf5e-4155-90a9-a089d790d4cf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:52.396136 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8b086405-bf5e-4155-90a9-a089d790d4cf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:52.403677 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8b086405-bf5e-4155-90a9-a089d790d4cf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:52.404137 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8b086405-bf5e-4155-90a9-a089d790d4cf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:52.404981 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8b086405-bf5e-4155-90a9-a089d790d4cf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:52.405424 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8b086405-bf5e-4155-90a9-a089d790d4cf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:52.471694 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8b086405-bf5e-4155-90a9-a089d790d4cf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.080771 Jan 17 21:38:52.472357 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 721/1447] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:52 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:53.483863 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8686830c-5bc3-494c-a0e8-4ed52d9b28fd tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:53.484924 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8686830c-5bc3-494c-a0e8-4ed52d9b28fd tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:53.492205 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8686830c-5bc3-494c-a0e8-4ed52d9b28fd tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:53.492693 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8686830c-5bc3-494c-a0e8-4ed52d9b28fd tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:53.493502 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8686830c-5bc3-494c-a0e8-4ed52d9b28fd tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:53.493948 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8686830c-5bc3-494c-a0e8-4ed52d9b28fd tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:53.565088 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8686830c-5bc3-494c-a0e8-4ed52d9b28fd tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.084974 Jan 17 21:38:53.565762 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 727/1448] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:53 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:54.577817 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5737c30d-1bf3-4948-911b-8d3f419861e7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:54.578847 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5737c30d-1bf3-4948-911b-8d3f419861e7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:54.586326 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5737c30d-1bf3-4948-911b-8d3f419861e7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:54.586775 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5737c30d-1bf3-4948-911b-8d3f419861e7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:54.588439 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5737c30d-1bf3-4948-911b-8d3f419861e7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:54.588878 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5737c30d-1bf3-4948-911b-8d3f419861e7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:54.657203 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5737c30d-1bf3-4948-911b-8d3f419861e7 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.083156 Jan 17 21:38:54.657886 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 722/1449] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:54 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:55.670333 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-5e1b6a80-f80d-4fcf-85f6-9f57efe919ff tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:55.671342 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-5e1b6a80-f80d-4fcf-85f6-9f57efe919ff tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:55.678415 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5e1b6a80-f80d-4fcf-85f6-9f57efe919ff tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:55.678871 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5e1b6a80-f80d-4fcf-85f6-9f57efe919ff tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:55.679666 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5e1b6a80-f80d-4fcf-85f6-9f57efe919ff tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:55.680109 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-5e1b6a80-f80d-4fcf-85f6-9f57efe919ff tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:55.748194 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-5e1b6a80-f80d-4fcf-85f6-9f57efe919ff tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.082356 Jan 17 21:38:55.748892 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 728/1450] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:55 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:56.760486 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-5201300f-23d5-4fcd-8a0e-82e9e537a0ea tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:56.761495 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-5201300f-23d5-4fcd-8a0e-82e9e537a0ea tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:56.768357 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5201300f-23d5-4fcd-8a0e-82e9e537a0ea tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:56.768846 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5201300f-23d5-4fcd-8a0e-82e9e537a0ea tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:56.769645 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5201300f-23d5-4fcd-8a0e-82e9e537a0ea tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:56.770091 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-5201300f-23d5-4fcd-8a0e-82e9e537a0ea tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:56.832697 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-5201300f-23d5-4fcd-8a0e-82e9e537a0ea tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.076040 Jan 17 21:38:56.833651 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 723/1451] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:56 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:57.845753 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-afa4fe8f-4c69-4d64-b588-267b73a3f23e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:57.846765 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-afa4fe8f-4c69-4d64-b588-267b73a3f23e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:57.854010 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-afa4fe8f-4c69-4d64-b588-267b73a3f23e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:57.854472 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-afa4fe8f-4c69-4d64-b588-267b73a3f23e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:57.855285 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-afa4fe8f-4c69-4d64-b588-267b73a3f23e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:57.855733 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-afa4fe8f-4c69-4d64-b588-267b73a3f23e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:57.917262 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-afa4fe8f-4c69-4d64-b588-267b73a3f23e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.075418 Jan 17 21:38:57.917936 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 729/1452] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:57 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:38:58.929789 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a21e8d59-8f0a-43a1-91c6-d220a138259b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:38:58.930812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a21e8d59-8f0a-43a1-91c6-d220a138259b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:38:58.938695 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a21e8d59-8f0a-43a1-91c6-d220a138259b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:58.939149 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a21e8d59-8f0a-43a1-91c6-d220a138259b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:58.939965 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a21e8d59-8f0a-43a1-91c6-d220a138259b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:38:58.940442 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a21e8d59-8f0a-43a1-91c6-d220a138259b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:38:59.004765 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a21e8d59-8f0a-43a1-91c6-d220a138259b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 28658 microversion: 2.1 time: 0.078881 Jan 17 21:38:59.005590 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 724/1453] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:38:58 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 28658 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:39:00.017757 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-a01bb202-899c-4860-88b1-32076f24bc19 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:39:00.018782 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-a01bb202-899c-4860-88b1-32076f24bc19 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:00.026859 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a01bb202-899c-4860-88b1-32076f24bc19 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:00.027333 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a01bb202-899c-4860-88b1-32076f24bc19 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:00.028144 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a01bb202-899c-4860-88b1-32076f24bc19 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:00.028620 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-a01bb202-899c-4860-88b1-32076f24bc19 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:00.101857 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-a01bb202-899c-4860-88b1-32076f24bc19 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 30188 microversion: 2.1 time: 0.088054 Jan 17 21:39:00.102771 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 730/1454] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:39:00 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 30188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:39:01.113996 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-c4dc12f9-2afc-4a06-9323-8515c1c48b18 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:39:01.114995 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-c4dc12f9-2afc-4a06-9323-8515c1c48b18 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:01.122364 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c4dc12f9-2afc-4a06-9323-8515c1c48b18 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:01.122812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c4dc12f9-2afc-4a06-9323-8515c1c48b18 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:01.123608 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c4dc12f9-2afc-4a06-9323-8515c1c48b18 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:01.124046 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-c4dc12f9-2afc-4a06-9323-8515c1c48b18 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:01.202379 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-c4dc12f9-2afc-4a06-9323-8515c1c48b18 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 32270 microversion: 2.1 time: 0.092173 Jan 17 21:39:01.203047 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 725/1455] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:39:01 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 32270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:39:02.215436 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-b3fedf5d-3e00-47ef-a78a-1ad6d2155b47 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:39:02.216497 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-b3fedf5d-3e00-47ef-a78a-1ad6d2155b47 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:02.223797 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b3fedf5d-3e00-47ef-a78a-1ad6d2155b47 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:02.224252 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b3fedf5d-3e00-47ef-a78a-1ad6d2155b47 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:02.225091 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b3fedf5d-3e00-47ef-a78a-1ad6d2155b47 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:02.225528 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-b3fedf5d-3e00-47ef-a78a-1ad6d2155b47 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:02.312022 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-b3fedf5d-3e00-47ef-a78a-1ad6d2155b47 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 33584 microversion: 2.1 time: 0.100402 Jan 17 21:39:02.312910 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 731/1456] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:39:02 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 33584 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:39:03.326723 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3a45d16e-8afb-45cc-9a56-8d7f227f38a5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:39:03.327658 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3a45d16e-8afb-45cc-9a56-8d7f227f38a5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:03.335349 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3a45d16e-8afb-45cc-9a56-8d7f227f38a5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:03.335805 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3a45d16e-8afb-45cc-9a56-8d7f227f38a5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:03.336648 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3a45d16e-8afb-45cc-9a56-8d7f227f38a5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:03.337095 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3a45d16e-8afb-45cc-9a56-8d7f227f38a5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:03.409339 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3a45d16e-8afb-45cc-9a56-8d7f227f38a5 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 34790 microversion: 2.1 time: 0.087348 Jan 17 21:39:03.410010 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 726/1457] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:39:03 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 34790 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:39:04.422503 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-3ba4d0cc-090a-4943-a609-105326fd93ce tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:39:04.423549 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-3ba4d0cc-090a-4943-a609-105326fd93ce tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:04.430772 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ba4d0cc-090a-4943-a609-105326fd93ce tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:04.431856 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ba4d0cc-090a-4943-a609-105326fd93ce tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:04.432724 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ba4d0cc-090a-4943-a609-105326fd93ce tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:04.433173 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-3ba4d0cc-090a-4943-a609-105326fd93ce tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:04.509096 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-3ba4d0cc-090a-4943-a609-105326fd93ce tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 35996 microversion: 2.1 time: 0.090372 Jan 17 21:39:04.509789 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 732/1458] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:39:04 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 35996 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 17 21:39:05.524038 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-8310a15a-6a58-46d9-93a1-3a5519ae1fab tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:39:05.525797 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-8310a15a-6a58-46d9-93a1-3a5519ae1fab tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:05.533601 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8310a15a-6a58-46d9-93a1-3a5519ae1fab tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:05.534117 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8310a15a-6a58-46d9-93a1-3a5519ae1fab tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:05.535024 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8310a15a-6a58-46d9-93a1-3a5519ae1fab tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:05.535554 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-8310a15a-6a58-46d9-93a1-3a5519ae1fab tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:05.612770 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-8310a15a-6a58-46d9-93a1-3a5519ae1fab tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 37769 microversion: 2.1 time: 0.092724 Jan 17 21:39:05.613510 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 727/1459] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:39:05 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 37769 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:39:06.626396 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-46fe829e-da63-4b60-b34a-1f2aded1182b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:39:06.627460 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-46fe829e-da63-4b60-b34a-1f2aded1182b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:06.634767 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-46fe829e-da63-4b60-b34a-1f2aded1182b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:06.635219 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-46fe829e-da63-4b60-b34a-1f2aded1182b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:06.636008 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-46fe829e-da63-4b60-b34a-1f2aded1182b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:06.636468 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-46fe829e-da63-4b60-b34a-1f2aded1182b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:06.704322 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-46fe829e-da63-4b60-b34a-1f2aded1182b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 38193 microversion: 2.1 time: 0.081864 Jan 17 21:39:06.705022 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 733/1460] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:39:06 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 38193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:39:07.717761 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-35fb41ef-6567-4250-8b71-ee4c1f3d6fc6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:39:07.718780 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-35fb41ef-6567-4250-8b71-ee4c1f3d6fc6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:07.726225 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-35fb41ef-6567-4250-8b71-ee4c1f3d6fc6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:07.726684 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-35fb41ef-6567-4250-8b71-ee4c1f3d6fc6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:07.727492 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-35fb41ef-6567-4250-8b71-ee4c1f3d6fc6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:07.727935 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-35fb41ef-6567-4250-8b71-ee4c1f3d6fc6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:07.790756 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-35fb41ef-6567-4250-8b71-ee4c1f3d6fc6 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 38193 microversion: 2.1 time: 0.076778 Jan 17 21:39:07.791425 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 728/1461] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:39:07 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 38193 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:39:08.803226 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-dcbf337a-f5ae-441e-9cb3-0c260072b005 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:39:08.804209 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-dcbf337a-f5ae-441e-9cb3-0c260072b005 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:08.811037 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dcbf337a-f5ae-441e-9cb3-0c260072b005 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:08.811487 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dcbf337a-f5ae-441e-9cb3-0c260072b005 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:08.812263 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dcbf337a-f5ae-441e-9cb3-0c260072b005 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:08.812746 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-dcbf337a-f5ae-441e-9cb3-0c260072b005 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:08.872664 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-dcbf337a-f5ae-441e-9cb3-0c260072b005 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 38193 microversion: 2.1 time: 0.073207 Jan 17 21:39:08.873316 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 734/1462] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:39:08 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 38193 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:39:09.885066 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-7cdacb0d-f1aa-4d5a-980b-66fba73482fe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:39:09.886102 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-7cdacb0d-f1aa-4d5a-980b-66fba73482fe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:09.893084 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7cdacb0d-f1aa-4d5a-980b-66fba73482fe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:09.893544 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7cdacb0d-f1aa-4d5a-980b-66fba73482fe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:09.894340 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7cdacb0d-f1aa-4d5a-980b-66fba73482fe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:09.894783 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-7cdacb0d-f1aa-4d5a-980b-66fba73482fe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:09.953734 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-7cdacb0d-f1aa-4d5a-980b-66fba73482fe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 38193 microversion: 2.1 time: 0.072981 Jan 17 21:39:09.954644 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 729/1463] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:39:09 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 38193 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:39:10.966397 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-fd8ad513-a6c2-42e6-8fb4-36d8ffe3cc91 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:39:10.967348 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-fd8ad513-a6c2-42e6-8fb4-36d8ffe3cc91 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:10.974233 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd8ad513-a6c2-42e6-8fb4-36d8ffe3cc91 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:10.974684 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd8ad513-a6c2-42e6-8fb4-36d8ffe3cc91 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:10.975459 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd8ad513-a6c2-42e6-8fb4-36d8ffe3cc91 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:10.975895 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-fd8ad513-a6c2-42e6-8fb4-36d8ffe3cc91 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:11.044763 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-fd8ad513-a6c2-42e6-8fb4-36d8ffe3cc91 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action" status: 200 len: 38324 microversion: 2.1 time: 0.082724 Jan 17 21:39:11.045420 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 735/1464] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jan 17 21:39:10 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/action => generated 38324 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 17 21:39:11.064317 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4d3bce00-fc89-4bda-b068-2a281901d0b1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:11.065181 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4d3bce00-fc89-4bda-b068-2a281901d0b1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:11.071812 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4d3bce00-fc89-4bda-b068-2a281901d0b1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:11.072269 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4d3bce00-fc89-4bda-b068-2a281901d0b1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:11.073078 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4d3bce00-fc89-4bda-b068-2a281901d0b1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:11.073518 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4d3bce00-fc89-4bda-b068-2a281901d0b1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:11.097534 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4d3bce00-fc89-4bda-b068-2a281901d0b1 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/ips" status: 200 len: 147 microversion: 2.1 time: 0.037187 Jan 17 21:39:11.098109 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 730/1465] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jan 17 21:39:11 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:39:12.404997 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-7b93a6c9-9b98-44b3-a341-e2c81d463795 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b18f29a-bf66-452c-9f0d-d72638ab6af3"}} {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:39:12.406132 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-7b93a6c9-9b98-44b3-a341-e2c81d463795 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:12.412931 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7b93a6c9-9b98-44b3-a341-e2c81d463795 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:12.413379 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7b93a6c9-9b98-44b3-a341-e2c81d463795 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:12.414153 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7b93a6c9-9b98-44b3-a341-e2c81d463795 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:12.414588 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-7b93a6c9-9b98-44b3-a341-e2c81d463795 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:12.640495 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-7b93a6c9-9b98-44b3-a341-e2c81d463795 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239394 Jan 17 21:39:12.641099 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 736/1466] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jan 17 21:39:12 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:39:20.111375 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-d249edee-6c39-4fc3-9587-8623ac48c12d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:20.112285 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-d249edee-6c39-4fc3-9587-8623ac48c12d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:20.118750 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d249edee-6c39-4fc3-9587-8623ac48c12d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:20.119202 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d249edee-6c39-4fc3-9587-8623ac48c12d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:20.119985 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d249edee-6c39-4fc3-9587-8623ac48c12d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:20.120454 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-d249edee-6c39-4fc3-9587-8623ac48c12d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:20.151693 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-d249edee-6c39-4fc3-9587-8623ac48c12d tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Jan 17 21:39:20.152243 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 731/1467] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:39:20 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 17 21:39:20.162903 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-129f774a-d6bf-4452-9573-5e18da5964df tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:20.163495 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-129f774a-d6bf-4452-9573-5e18da5964df tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:20.169573 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-129f774a-d6bf-4452-9573-5e18da5964df tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:20.170032 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-129f774a-d6bf-4452-9573-5e18da5964df tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:20.170815 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-129f774a-d6bf-4452-9573-5e18da5964df tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:20.171259 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-129f774a-d6bf-4452-9573-5e18da5964df tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:20.199574 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-129f774a-d6bf-4452-9573-5e18da5964df tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments/1b18f29a-bf66-452c-9f0d-d72638ab6af3" status: 200 len: 194 microversion: 2.1 time: 0.041265 Jan 17 21:39:20.200152 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 737/1468] 10.222.0.64 () {58 vars in 1412 bytes} [Mon Jan 17 21:39:20 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments/1b18f29a-bf66-452c-9f0d-d72638ab6af3 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:39:21.497456 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-dbfc784e-b460-4aa2-809a-95496dd32b15 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f18c764b-e5d9-4335-83cb-c6a665d9a9f0"}} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:39:21.498505 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-dbfc784e-b460-4aa2-809a-95496dd32b15 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:21.504758 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dbfc784e-b460-4aa2-809a-95496dd32b15 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:21.505220 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dbfc784e-b460-4aa2-809a-95496dd32b15 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:21.506002 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dbfc784e-b460-4aa2-809a-95496dd32b15 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:21.506442 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-dbfc784e-b460-4aa2-809a-95496dd32b15 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:21.744833 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-dbfc784e-b460-4aa2-809a-95496dd32b15 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251231 Jan 17 21:39:21.745452 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 732/1469] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jan 17 21:39:21 2022] POST /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:39:29.214829 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-55abb62a-fc28-428f-a3b0-f93505a3a6ee tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:29.215735 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-55abb62a-fc28-428f-a3b0-f93505a3a6ee tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:29.222010 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-55abb62a-fc28-428f-a3b0-f93505a3a6ee tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:29.222465 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-55abb62a-fc28-428f-a3b0-f93505a3a6ee tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:29.223245 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-55abb62a-fc28-428f-a3b0-f93505a3a6ee tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:29.223688 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-55abb62a-fc28-428f-a3b0-f93505a3a6ee tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:29.254137 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-55abb62a-fc28-428f-a3b0-f93505a3a6ee tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043538 Jan 17 21:39:29.254657 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 738/1470] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:39:29 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:39:29.459488 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-0541364b-3398-4753-bb88-a57c77fb86f9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:29.460094 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-0541364b-3398-4753-bb88-a57c77fb86f9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:29.467423 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0541364b-3398-4753-bb88-a57c77fb86f9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:29.467884 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0541364b-3398-4753-bb88-a57c77fb86f9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:29.468705 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0541364b-3398-4753-bb88-a57c77fb86f9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:29.469155 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-0541364b-3398-4753-bb88-a57c77fb86f9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:29.497934 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-0541364b-3398-4753-bb88-a57c77fb86f9 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments/1b18f29a-bf66-452c-9f0d-d72638ab6af3" status: 200 len: 194 microversion: 2.1 time: 0.042857 Jan 17 21:39:29.498527 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 733/1471] 10.222.0.64 () {58 vars in 1412 bytes} [Mon Jan 17 21:39:29 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments/1b18f29a-bf66-452c-9f0d-d72638ab6af3 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:39:29.507935 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-35fe7e10-e693-4821-bc3f-b4ad033fc6b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:29.508354 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-35fe7e10-e693-4821-bc3f-b4ad033fc6b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:29.515203 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35fe7e10-e693-4821-bc3f-b4ad033fc6b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:29.515656 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35fe7e10-e693-4821-bc3f-b4ad033fc6b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:29.516471 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35fe7e10-e693-4821-bc3f-b4ad033fc6b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:29.516915 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-35fe7e10-e693-4821-bc3f-b4ad033fc6b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:29.591825 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-35fe7e10-e693-4821-bc3f-b4ad033fc6b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lazy-loading 'services' on Instance uuid fdf5db38-0987-41cc-b468-2267aac17deb {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:39:29.658731 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-35fe7e10-e693-4821-bc3f-b4ad033fc6b0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments/1b18f29a-bf66-452c-9f0d-d72638ab6af3" status: 202 len: 0 microversion: 2.1 time: 0.154333 Jan 17 21:39:29.659312 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 739/1472] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jan 17 21:39:29 2022] DELETE /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments/1b18f29a-bf66-452c-9f0d-d72638ab6af3 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:39:30.768400 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-a97c8c99-3bcb-4335-9402-6a4aa7fee40b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:30.769000 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-a97c8c99-3bcb-4335-9402-6a4aa7fee40b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:30.775856 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a97c8c99-3bcb-4335-9402-6a4aa7fee40b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:30.776315 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a97c8c99-3bcb-4335-9402-6a4aa7fee40b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:30.777124 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a97c8c99-3bcb-4335-9402-6a4aa7fee40b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:30.777567 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-a97c8c99-3bcb-4335-9402-6a4aa7fee40b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:30.805567 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-a97c8c99-3bcb-4335-9402-6a4aa7fee40b tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments/f18c764b-e5d9-4335-83cb-c6a665d9a9f0" status: 200 len: 194 microversion: 2.1 time: 0.040852 Jan 17 21:39:30.806144 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 734/1473] 10.222.0.64 () {58 vars in 1412 bytes} [Mon Jan 17 21:39:30 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments/f18c764b-e5d9-4335-83cb-c6a665d9a9f0 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:39:30.816715 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-6e5402c2-7e94-4410-8f8b-54d009628229 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:30.817292 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-6e5402c2-7e94-4410-8f8b-54d009628229 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:30.823815 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6e5402c2-7e94-4410-8f8b-54d009628229 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:30.824253 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6e5402c2-7e94-4410-8f8b-54d009628229 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:30.825055 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6e5402c2-7e94-4410-8f8b-54d009628229 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:30.825487 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-6e5402c2-7e94-4410-8f8b-54d009628229 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:30.900522 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.objects.instance [None req-6e5402c2-7e94-4410-8f8b-54d009628229 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lazy-loading 'services' on Instance uuid fdf5db38-0987-41cc-b468-2267aac17deb {{(pid=116182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 17 21:39:30.968482 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-6e5402c2-7e94-4410-8f8b-54d009628229 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments/f18c764b-e5d9-4335-83cb-c6a665d9a9f0" status: 202 len: 0 microversion: 2.1 time: 0.156159 Jan 17 21:39:30.969069 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 740/1474] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jan 17 21:39:30 2022] DELETE /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments/f18c764b-e5d9-4335-83cb-c6a665d9a9f0 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 17 21:39:32.125186 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-087f8131-0f79-4c61-879d-067924ca2b71 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:32.126105 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-087f8131-0f79-4c61-879d-067924ca2b71 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:32.132385 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-087f8131-0f79-4c61-879d-067924ca2b71 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:32.132863 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-087f8131-0f79-4c61-879d-067924ca2b71 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:32.133651 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-087f8131-0f79-4c61-879d-067924ca2b71 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:32.134104 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-087f8131-0f79-4c61-879d-067924ca2b71 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:32.161645 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-087f8131-0f79-4c61-879d-067924ca2b71 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040186 Jan 17 21:39:32.162195 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 735/1475] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:39:32 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:39:32.263005 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-89ca2e4b-fda2-4093-bac1-48c9031ad1fe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:32.264003 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-89ca2e4b-fda2-4093-bac1-48c9031ad1fe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:32.270047 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-89ca2e4b-fda2-4093-bac1-48c9031ad1fe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:32.270506 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-89ca2e4b-fda2-4093-bac1-48c9031ad1fe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:32.271355 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-89ca2e4b-fda2-4093-bac1-48c9031ad1fe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:32.271809 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-89ca2e4b-fda2-4093-bac1-48c9031ad1fe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:32.299880 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-89ca2e4b-fda2-4093-bac1-48c9031ad1fe tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041900 Jan 17 21:39:32.300447 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 741/1476] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jan 17 21:39:32 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 17 21:39:32.354124 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-4c69f233-213d-4d24-935a-2416ee1222f4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:32.354627 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4c69f233-213d-4d24-935a-2416ee1222f4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:32.360511 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c69f233-213d-4d24-935a-2416ee1222f4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:32.360970 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c69f233-213d-4d24-935a-2416ee1222f4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:32.361747 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c69f233-213d-4d24-935a-2416ee1222f4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:32.362190 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-4c69f233-213d-4d24-935a-2416ee1222f4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:32.386273 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-4c69f233-213d-4d24-935a-2416ee1222f4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Going to try to terminate instance {{(pid=116183) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 17 21:39:32.471834 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-4c69f233-213d-4d24-935a-2416ee1222f4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 204 len: 0 microversion: 2.1 time: 0.120960 Jan 17 21:39:32.472758 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 736/1477] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:39:32 2022] DELETE /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 17 21:39:32.480757 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-338449b5-0939-4797-a8d6-86fa22b87c40 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:32.481379 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-338449b5-0939-4797-a8d6-86fa22b87c40 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:32.487204 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-338449b5-0939-4797-a8d6-86fa22b87c40 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:32.487716 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-338449b5-0939-4797-a8d6-86fa22b87c40 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:32.488493 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-338449b5-0939-4797-a8d6-86fa22b87c40 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:32.488943 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-338449b5-0939-4797-a8d6-86fa22b87c40 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:32.624005 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-338449b5-0939-4797-a8d6-86fa22b87c40 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:39:32.631320 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-338449b5-0939-4797-a8d6-86fa22b87c40 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 200 len: 1675 microversion: 2.1 time: 0.154332 Jan 17 21:39:32.631899 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 742/1478] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:39:32 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:39:33.650138 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b62adef2-f6a5-44af-a886-fa1109fddb1c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:33.650835 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-b62adef2-f6a5-44af-a886-fa1109fddb1c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:33.657090 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b62adef2-f6a5-44af-a886-fa1109fddb1c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:33.657541 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b62adef2-f6a5-44af-a886-fa1109fddb1c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:33.658317 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b62adef2-f6a5-44af-a886-fa1109fddb1c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:33.658753 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-b62adef2-f6a5-44af-a886-fa1109fddb1c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:33.800226 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.policy [None req-b62adef2-f6a5-44af-a886-fa1109fddb1c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116183) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:39:33.807606 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b62adef2-f6a5-44af-a886-fa1109fddb1c tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 200 len: 1675 microversion: 2.1 time: 0.162088 Jan 17 21:39:33.808169 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 737/1479] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:39:33 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:39:34.825150 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-41d12641-0bfb-4830-93f7-411d983845ae tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:34.825864 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-41d12641-0bfb-4830-93f7-411d983845ae tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:34.832444 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41d12641-0bfb-4830-93f7-411d983845ae tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:34.833103 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41d12641-0bfb-4830-93f7-411d983845ae tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:34.833919 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41d12641-0bfb-4830-93f7-411d983845ae tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:34.834365 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-41d12641-0bfb-4830-93f7-411d983845ae tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:34.969370 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.policy [None req-41d12641-0bfb-4830-93f7-411d983845ae tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844c17f7d55f4d66893be8af81851331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ad2da51ac441986f9af1c8c6a30c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116182) authorize /opt/stack/nova/nova/policy.py:199}} Jan 17 21:39:34.977415 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-41d12641-0bfb-4830-93f7-411d983845ae tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 200 len: 1675 microversion: 2.1 time: 0.156069 Jan 17 21:39:34.978565 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 743/1480] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:39:34 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 17 21:39:35.554680 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [req-7ea420bb-fef8-4020-a8fc-343bde3a2cd6 req-3b5cd586-9d8e-4b72-84a6-d628bf642ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf5db38-0987-41cc-b468-2267aac17deb", "name": "network-vif-deleted", "tag": "84638381-a10a-423e-ae50-4f652a10d4f3"}]} {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 17 21:39:35.557117 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 17 21:39:35.557117 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: warnings.warn(msg) Jan 17 21:39:35.567525 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-7ea420bb-fef8-4020-a8fc-343bde3a2cd6 req-3b5cd586-9d8e-4b72-84a6-d628bf642ba6 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:35.567971 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [req-7ea420bb-fef8-4020-a8fc-343bde3a2cd6 req-3b5cd586-9d8e-4b72-84a6-d628bf642ba6 service nova] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:35.581628 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.compute.server_external_events [req-7ea420bb-fef8-4020-a8fc-343bde3a2cd6 req-3b5cd586-9d8e-4b72-84a6-d628bf642ba6 service nova] Creating event network-vif-deleted:84638381-a10a-423e-ae50-4f652a10d4f3 for instance fdf5db38-0987-41cc-b468-2267aac17deb on hv-cinder-82489 Jan 17 21:39:35.588472 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [req-7ea420bb-fef8-4020-a8fc-343bde3a2cd6 req-3b5cd586-9d8e-4b72-84a6-d628bf642ba6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037235 Jan 17 21:39:35.589088 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 738/1481] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jan 17 21:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 17 21:39:35.996791 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8c365574-f329-4bfc-92e2-697da0f7a9d0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:35.998579 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-8c365574-f329-4bfc-92e2-697da0f7a9d0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:36.005602 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8c365574-f329-4bfc-92e2-697da0f7a9d0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:36.006404 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8c365574-f329-4bfc-92e2-697da0f7a9d0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:36.007543 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8c365574-f329-4bfc-92e2-697da0f7a9d0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:36.008153 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-8c365574-f329-4bfc-92e2-697da0f7a9d0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:36.022273 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-8c365574-f329-4bfc-92e2-697da0f7a9d0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] HTTP exception thrown: Instance fdf5db38-0987-41cc-b468-2267aac17deb could not be found. Jan 17 21:39:36.022872 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-8c365574-f329-4bfc-92e2-697da0f7a9d0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Returning 404 to user: Instance fdf5db38-0987-41cc-b468-2267aac17deb could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:39:36.023722 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-8c365574-f329-4bfc-92e2-697da0f7a9d0 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 404 len: 111 microversion: 2.1 time: 0.032258 Jan 17 21:39:36.027821 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 744/1482] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:39:35 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:39:36.032991 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-b8a2bf73-034a-4f35-b6c8-7185e39945bf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '.version_select at 0x7f8976ae6a60>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:36.052584 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-b8a2bf73-034a-4f35-b6c8-7185e39945bf tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1846209742" status: 202 len: 0 microversion: 2.1 time: 0.023395 Jan 17 21:39:36.053172 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 739/1483] 10.222.0.64 () {58 vars in 1220 bytes} [Mon Jan 17 21:39:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1846209742 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 17 21:39:38.988187 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-248b3316-8953-4399-bdc2-f25a4ecf92a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:38.988719 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-248b3316-8953-4399-bdc2-f25a4ecf92a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:38.995680 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-248b3316-8953-4399-bdc2-f25a4ecf92a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:38.996134 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-248b3316-8953-4399-bdc2-f25a4ecf92a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:38.996951 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-248b3316-8953-4399-bdc2-f25a4ecf92a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:38.997394 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-248b3316-8953-4399-bdc2-f25a4ecf92a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:39.010323 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-248b3316-8953-4399-bdc2-f25a4ecf92a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] HTTP exception thrown: Instance fdf5db38-0987-41cc-b468-2267aac17deb could not be found. Jan 17 21:39:39.010897 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-248b3316-8953-4399-bdc2-f25a4ecf92a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Returning 404 to user: Instance fdf5db38-0987-41cc-b468-2267aac17deb could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:39:39.011715 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-248b3316-8953-4399-bdc2-f25a4ecf92a4 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 404 len: 111 microversion: 2.1 time: 0.027246 Jan 17 21:39:39.012247 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 745/1484] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:39:38 2022] DELETE /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:39:39.019815 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-274ab0ef-481c-4d99-bb75-8c9d77f4233e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:39.020630 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-274ab0ef-481c-4d99-bb75-8c9d77f4233e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: fdf5db38-0987-41cc-b468-2267aac17deb] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:39.027052 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-274ab0ef-481c-4d99-bb75-8c9d77f4233e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:39.027503 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-274ab0ef-481c-4d99-bb75-8c9d77f4233e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:39.028281 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-274ab0ef-481c-4d99-bb75-8c9d77f4233e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:39.028813 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-274ab0ef-481c-4d99-bb75-8c9d77f4233e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:39.041851 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-274ab0ef-481c-4d99-bb75-8c9d77f4233e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] HTTP exception thrown: Instance fdf5db38-0987-41cc-b468-2267aac17deb could not be found. Jan 17 21:39:39.042435 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-274ab0ef-481c-4d99-bb75-8c9d77f4233e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Returning 404 to user: Instance fdf5db38-0987-41cc-b468-2267aac17deb could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:39:39.043242 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-274ab0ef-481c-4d99-bb75-8c9d77f4233e tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb" status: 404 len: 111 microversion: 2.1 time: 0.027070 Jan 17 21:39:39.043760 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 740/1485] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:39:39 2022] GET /compute/v2.1/servers/fdf5db38-0987-41cc-b468-2267aac17deb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:39:40.171063 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d6994689-86f1-45da-a110-8b6bb42b7930 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:40.171572 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.compute.api [None req-d6994689-86f1-45da-a110-8b6bb42b7930 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116182) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:40.178203 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d6994689-86f1-45da-a110-8b6bb42b7930 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:40.178665 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d6994689-86f1-45da-a110-8b6bb42b7930 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:40.179461 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d6994689-86f1-45da-a110-8b6bb42b7930 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:40.179907 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG oslo_concurrency.lockutils [None req-d6994689-86f1-45da-a110-8b6bb42b7930 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:40.193769 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.wsgi [None req-d6994689-86f1-45da-a110-8b6bb42b7930 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] HTTP exception thrown: Instance 36e5d4f4-8056-4422-9c56-c4d15421e8ff could not be found. Jan 17 21:39:40.194374 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: DEBUG nova.api.openstack.wsgi [None req-d6994689-86f1-45da-a110-8b6bb42b7930 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Returning 404 to user: Instance 36e5d4f4-8056-4422-9c56-c4d15421e8ff could not be found. {{(pid=116182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:39:40.195217 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO nova.api.openstack.requestlog [None req-d6994689-86f1-45da-a110-8b6bb42b7930 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "DELETE /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 404 len: 111 microversion: 2.1 time: 0.027806 Jan 17 21:39:40.195764 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: [pid: 116182|app: 0|req: 746/1486] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jan 17 21:39:40 2022] DELETE /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:39:40.203732 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3978e3c5-13f9-448f-865d-a8d25326bb16 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Calling method '>' {{(pid=116183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 17 21:39:40.204340 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.compute.api [None req-3978e3c5-13f9-448f-865d-a8d25326bb16 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] [instance: 36e5d4f4-8056-4422-9c56-c4d15421e8ff] Fetching instance by UUID {{(pid=116183) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 17 21:39:40.211056 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3978e3c5-13f9-448f-865d-a8d25326bb16 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:40.211506 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3978e3c5-13f9-448f-865d-a8d25326bb16 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:40.212881 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3978e3c5-13f9-448f-865d-a8d25326bb16 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 17 21:39:40.213322 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG oslo_concurrency.lockutils [None req-3978e3c5-13f9-448f-865d-a8d25326bb16 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Lock "c701e1f9-5e14-4d1d-beb5-81eb20dd71e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 17 21:39:40.226413 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.wsgi [None req-3978e3c5-13f9-448f-865d-a8d25326bb16 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] HTTP exception thrown: Instance 36e5d4f4-8056-4422-9c56-c4d15421e8ff could not be found. Jan 17 21:39:40.226907 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: DEBUG nova.api.openstack.wsgi [None req-3978e3c5-13f9-448f-865d-a8d25326bb16 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] Returning 404 to user: Instance 36e5d4f4-8056-4422-9c56-c4d15421e8ff could not be found. {{(pid=116183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 17 21:39:40.228306 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO nova.api.openstack.requestlog [None req-3978e3c5-13f9-448f-865d-a8d25326bb16 tempest-AttachVolumeTestJSON-1487223513 tempest-AttachVolumeTestJSON-1487223513-project] 10.222.0.64 "GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff" status: 404 len: 111 microversion: 2.1 time: 0.027719 Jan 17 21:39:40.228866 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: [pid: 116183|app: 0|req: 741/1487] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jan 17 21:39:40 2022] GET /compute/v2.1/servers/36e5d4f4-8056-4422-9c56-c4d15421e8ff => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 17 21:40:16.276800 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:40:16.277406 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: Mon Jan 17 21:40:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 21:40:23.851589 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:40:23.852184 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: Mon Jan 17 21:40:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 21:40:28.759200 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:40:28.759764 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: Mon Jan 17 21:40:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 21:42:21.117807 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:42:21.118582 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: Mon Jan 17 21:42:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 21:42:23.860343 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:42:23.860958 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: Mon Jan 17 21:42:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 21:43:36.285699 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:43:36.286951 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: Mon Jan 17 21:43:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 21:43:43.860512 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:43:43.861087 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: Mon Jan 17 21:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 21:43:48.768839 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:43:48.769513 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: Mon Jan 17 21:43:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 21:45:27.341486 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:45:27.342091 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: Mon Jan 17 21:45:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 21:45:41.126051 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:45:41.126644 dv-cinder-824895-3-iscsi devstack@n-api.service[116182]: Mon Jan 17 21:45:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 17 21:45:43.868642 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 17 21:45:43.869191 dv-cinder-824895-3-iscsi devstack@n-api.service[116183]: Mon Jan 17 21:45:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!